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Executive  Summary 


The  trend  in  the  coatings  industry  today  is  away  from  composition  specifications 
and  toward  performance  specifications.  Standardized  levels  of  coating  performance 
could  he  promulgated  as  industry-wide  reference  points  through  the  establishment 
of  benchmarks.  The  term  benchmark  TCia.y  be  defined  simply  as  a  widely  recognized 
measure  of  performance.  An  established  government  or  industry  standard  (such  as 
MIL-P-24441  for  an  epoxy  system  or  SSPC  Paint  25/TT-E-489  for  an  oil-based  sys¬ 
tem)  could  serve  as  a  benchmark,  as  could  a  brand-name  paint  that  is  well  known 
and  accepted  industry-wide  for  its  level  of  performance  in  its  intended  application. 

To  write  performance  specifications  and  establish  benchmarks  for  coating  systems, 
reliable  and  reproducible  test  methods  must  be  used  to  determine  pass/fail  criteria. 
Undercutting  at  the  scribe  is  a  common  mode  of  deterioration  in  coating  systems 
applied  to  structural  steel.  A  method  for  testing  coatings  for  this  type  of  damage  is 
prescribed  by  ASTM  D  5894. 

The  objective  of  this  research  was  to  establish  as  benchmarks  a  number  of  well- 
known  coating  systems  whose  performance  is  widely  accepted  by  users  throughout 
the  industry.  Performance  levels  of  the  selected  benchmark  coatings  were  tested  us¬ 
ing  ASTM  D  5894,  and  two  alternative  methods  of  assessing  the  damage  were 
evaluated  for  reliability  and  reproducibility. 

A  standard  method  of  assessing  and  quantifying  the  extent  of  scribe  undercutting 
should  possess  the  following  properties: 

•  The  method  should  be  straightforward  and  easy  to  use  without  the  need  for 
sophisticated  tools  such  as  electronic  scanners; 

•  The  method  should  be  accurate  and  minimize  subjective  judgments  of  the 
evaluator; 

•  The  method  should  have  enough  sensitivity  to  differentiate  among  coating 
systems  with  different  levels  of  performance; 

•  The  method  should  be  reproducible; 

•  Computations  should  be  able  to  be  performed  on  any  commercial  statistics 
software  package  or  even  on  a  hand-held  calculator. 
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Nine  different  well-known  painting  systems  representing  a  variety  of  generic  types 
were  exposed  in  an  accelerated  cyclic  laboratory  test  described  by  ASTM  D  5894.  Six 
or  seven  replicate  panels  for  each  system  were  prepared  and  scribed  prior  to  expo¬ 
sure. 

This  project  investigated  two  general  methods  for  assessing  scribe  undercutting.  In 
Method  1  (overall  means),  one  determines  the  mean  (average)  undercutting  from 
measurements  taken  at  a  large  number  of  pre-selected  positions  along  the  scribe.  In 
Method  2  (average  maximum),  one  measures  the  maximum  undercutting  value 
along  the  entire  scribe,  or  a  designated  portion  of  the  scribe,  and  computes  the  av¬ 
erage  of  these  maxima. 

Within  each  method  there  are  variations  of  the  specific  procedure.  For  Method  1, 
one  must  select  the  number  and  spacing  of  the  location  to  measure.  For  Method  2, 
one  can  determine  the  maximum  of  the  entire  scribe  or  of  selected  increments  along 
the  scribe  (e.g.,  along  10-mm  intervals).  Several  such  variations  were  investigated 
for  Method  2.  In  addition,  alternative  statistical  methods  may  be  used  to  analyze 
the  data.  In  this  project,  the  methods  used  were  analysis  of  means,  analysis  of  vari¬ 
ance,  and  Weibull  distribution. 

Either  method  may  be  used  to  establish  a  benchmark  based  on  statistical  principles. 
Method  2  will  compute  scribe-undercutting  levels  that  are  higher  than  those  from 
Method  1  because  one  is  measuring  a  maximum  undercutting  rather  than  the  un¬ 
dercutting  at  specific  intervals.  The  ratio  of  these  two  quantities  depends  on  the 
number  of  measurements  taken  and  the  type  of  distribution  of  scribe  undercutting. 
In  these  experiments,  the  average  maximum  was  about  20  to  30%  higher  than  the 
overall  mean. 

For  this  experiment.  Method  1  involved  measuring  the  undercutting  to  the  left  and 
to  the  right  of  the  centerline  at  5-mm  intervals  along  the  length  of  the  scribe.  For  a 
60-mm  long  scribe,  12  measurements  were  made  to  the  left  and  12  to  the  right  for  a 
total  of  24  measurements  per  scribe.  Since  each  panel  had  two  scribes,  there  were 
48  measurements  per  panel.  Six  panels  in  a  set  gave  288  data  points  for  each  set. 
The  288  data  points  from  Method  1  closely  followed  a  normal  distribution.  The 
method  treats  all  the  data  (288  measurements)  from  the  12  scribes  as  a  single  popu¬ 
lation.  Using  a  calculator,  compute  the  mean  and  the  standard  deviation.  Multiply 
the  standard  deviation  by  two  and  add  this  to  the  mean.  The  resulting  figure, 
rounded  to  the  nearest  millimeter,  is  the  scribe  parameter  or  benchmark. 

For  the  initial  analysis  with  Method  2,  12  measurements,  the  maximum  undercut¬ 
ting  at  each  scribe,  were  taken.  The  mean  plus  two  standard  deviations  computed 
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from  these  12  measurements  constituted  the  Method  2  benchmark.  The  maximum 
undercutting  at  the  scrihe  on  a  similar  panel  would  have  more  than  a  95%  prohahil- 
ity  of  being  less  than  this  benchmark. 

A  Weibull  analysis  was  also  done  on  the  12  data  points  representing  maximum  un¬ 
dercutting  of  the  12  scribes.  The  95%  probability  target  is  very  close  to  the  bench¬ 
mark  computed  with  statistics  based  on  analysis  of  mean. 

Analysis  of  Reduced  Data  Sets 

It  is  useful  to  determine  the  validity  of  the  method  for  experimenting  with  fewer 
than  12  replicate  scribes.  Method  2  data  was  analyzed  using  reduced  data  sets,  two 
panels  with  two  scribes  each  (4  scribes  compared  to  12  in  the  full  set).  The  analysis 
yielded  benchmarks  comparable  to  those  derived  from  larger  numbers  of  replicates. 
In  this  case,  the  benchmark  was  derived  from  two  replicate  panels  (four  scribes)  in 
which  each  scribe  was  divided  into  three  equal  portions  with  the  maximum  under¬ 
cutting  on  each  portion  considered  a  separate  data  point.  Note:  It  is  recognized 
that  under  rigorous  statistical  methodology  these  points  would  not  be  considered 
independent  measurements. 

Analysis  of  CERL  Test  Panels 

The  analysis  showed  that  either  method  was  satisfactory  to  produce  a  statistically 
valid  undercutting  benchmark  for  the  data  in  these  experiments.  The  test  panels 
furnished  by  CERL  included  a  relatively  large  number  (six)  of  replicate  panels.  With 
2  scribes  on  each  panel,  there  was  a  total  of  12  scribes.  This  resulted  in  288  individ¬ 
ual  data  points  for  Method  1  and  12  maxima  for  Method  2.  Because  Method  2  is  eas¬ 
ier  to  use  and  because  it  has  a  close  linear  relationship  with  Method  1,  it  is  recom¬ 
mended  as  the  preferred  industry  practice. 

For  these  experiments.  Method  2  was  also  considered  suitable  for  data  sets  with 
fewer  replicates.  For  this  situation,  one  divides  the  scribes  into  equal  lengths  and 
measures  the  maximum  undercutting  within  each  segment.  Each  segment  is  then 
treated  as  an  independent  measurement.  This  approach  may  require  additional 
verification  for  practical  and  statistical  validity. 

Use  of  Benchmark  Criteria 

Specifiers  seek  a  means  to  determine  if  a  candidate  coating  meets  the  performance 
levels  of  a  known  proven  coating  system.  The  results  of  this  project  indicate  that 
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scribe  undercutting  can  provide  a  suitable  benchmark  for  performance  of  high  tech¬ 
nology  coatings  in  an  accelerated  cyclic  corrosion  cabinet  test  (ASTM  D  5894). 

The  coating  systems  examined  in  this  project  represent  the  range  of  generic  systems 
most  commonly  used  in  industry.  The  test  systems  also  have  a  history  of  good  per¬ 
formance  in  industrial  applications.  For  example,  the  Method  2  benchmark  was 
13-mm  for  System  2,  a  zinc-rich  epoxy  primer/epoxy  topcoat  system.  Aperformance 
specification  for  this  type  of  coating  system  could  require  scribe  undercutting  after 
3360  hours  (20  weeks)  exposure  in  ASTM  D  5894  to  be  less  than  15  mm  as  meas¬ 
ured  by  Method  2.  If  the  test  coating  met  this  requirement,  there  would  be  a  high 
likelihood  of  having  atmospheric  performance  at  least  as  good  as  the  zinc-rich  epoxy 
system  examined  in  this  study.  The  target  of  15  mm  instead  of  13  mm  would  allow 
for  fluctuations  in  the  panel  preparation  and  other  testing  conditions.  As  more  coat¬ 
ings  are  tested  according  to  this  criterion,  the  target  could  be  adjusted  up  or  down  to 
accommodate  experience  and  the  state  of  the  technology. 

There  was  good  reproducibility  when  the  same  observer  remeasured  the  scribes  and 
there  was  good  agreement  among  three  different  observers  in  computing  bench¬ 
marks  by  any  of  the  methods.  System  1  had  data  for  three  different  exposure  times, 
ten  weeks,  16  weeks,  and  20  weeks.  Because  of  an  apparent  data  reversal,  the  Sys¬ 
tem  1  data  suggest  a  variation  between  separate  runs  on  the  order  of  10  to  20%. 

Based  on  these  data,  general  procedures  are  proposed  for: 

•  Deriving  a  benchmark  for  scribe  undercutting 

•  Evaluating  a  candidate  system  against  the  benchmark 

Proposed  Method  for  Deriving  a  Benchmark  for  Scrihe  Undercutting 

1.  Prepare  replicate  test  specimens  of  the  coating  system  to  be  benchmarked. 

2.  Scribe  each  of  the  panels  in  accordance  with  standard  procedures. 

3.  Identify  12  separate  scribes  or  scribe  segments  of  at  least  20  mm  in  length.  (The 
replicates  must  provide  a  minimum  of  four  scribed  areas  of  at  least  60  mm  each.) 

4.  Expose  the  test  specimens  for  which  a  benchmark  performance  is  sought  in  a 
cabinet  or  environment  conforming  to  ASTM  D  5894.  A  minimum  duration  is  five 
cycles  (10  weeks  or  1680  hours). 

5.  Measure  the  maximum  undercutting  at  each  of  the  scribes  or  scribe  segments. 

6.  Compute  the  mean  and  standard  deviation  for  each  coating  system.  The  bench¬ 
mark  is  the  mean  plus  two  standard  deviations. 
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Proposed  Method  for  Evaluating  a  Candidate  System  Against  the  Bench¬ 
mark 

1.  Prepare  replicate  test  specimens  of  the  candidate  coating  system. 

2.  Scribe  each  of  the  panels  in  accordance  with  standard  procedures.  A  minimum  of 
two  test  specimens  and  four  scribed  areas  of  at  least  60  mm  each  is  required. 

3.  Expose  the  replicate  specimens  in  the  test  cabinets  for  the  prescribed  time  and 
test  parameters. 

4.  Measure  scribe  in  accordance  with  procedure  above. 

5.  Compute  the  average  and  standard  deviation  of  the  maximum  undercutting  of 
the  scribe  segments.  These  parameters  must  be  comparable  to  previously  estab¬ 
lished  benchmarks. 

Note:  Additional  criteria  can  be  established  for  an  alternate  number  of  measure¬ 
ments. 

There  is  no  reason  that  these  methods  of  evaluating  scribe  undercutting  could  not 
be  used  for  panels  on  a  test  fence.  The  benchmarks  would  have  to  be  determined  for 
each  generic  coating  system  for  different  atmospheric  exposure  conditions,  such  as 
heavy  industrial,  light  industrial,  or  marine.  The  variability  of  the  data  and  the 
number  of  replicates  needed  would  have  to  be  ascertained.  This  is  a  project  for  fu¬ 
ture  work. 
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1  Introduction 


Background 

The  revised  Federal  Acquisition  Regulation  (FAR)  requires  that  government  agen¬ 
cies  procure  commercial  services  and  products  to  the  greatest  extent  practicable. 
FAR  also  states  that  procurement  of  commercial  products  should  he  based  on  per¬ 
formance,  and  industry  criteria  documents  are  preferred  over  Government  specifica¬ 
tions.  The  Construction  Engineering  Research  Laboratory  (CERL),  an  element  of 
the  U.S.  Army  Engineer  Research  and  Development  Center  (ERDC),  is  working 
with  The  Society  for  Protective  Coatings  (SSPC)  to  standardize  a  format  for  per¬ 
formance-based  paint  specifications.  Accelerated  laboratory  testing  is  the  logical 
and  rapid  way  to  specify  coating  performance.  However,  this  approach  is  hampered 
by  a  lack  of  readily  accessible  performance  data.  Furthermore,  the  interpretation  of 
rust  undercutting  data  is  poorly  understood  and  must  be  elucidated  if  pass/fail  per¬ 
formance  criteria  based  on  coating  reliability  are  to  be  implemented.  Benchmarks 
for  performance  are  needed  as  a  reference  point  prior  to  the  development  of  per¬ 
formance-based  paint  specifications. 


Objectives 

The  objectives  of  this  research  are  to: 

1.  Develop  a  rigorous  method  for  evaluating  and  interpreting  rust  undercutting 
data  from  test  specimens. 

2.  Report  on  performance  “benchmarking”  experiments  conducted  on  these  coating 
systems. 


Approach 

Test  panels  coated  with  one  of  nine  different  well-known  painting  systems  repre¬ 
senting  a  variety  of  generic  types  were  exposed  for  up  to  20  weeks  in  an  accelerated 
cyclic  laboratory  test  described  by  ASTM  D  5894.  The  extent  of  rust  undercutting  at 
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the  scribes  was  measured  using  two  alternative  well-defined  procedures.  The  re¬ 
sults  of  these  procedures  were  compared. 


Scope 

This  project  measured  undercutting  for  selected  two-  and  three-coat  systems. 
Benchmarking  for  single  coat  systems  or  for  generic  types  not  tested  here  will  have 
to  be  the  object  of  another  investigation.  The  method  of  measuring  and  characteriz¬ 
ing  the  scribe  can  be  applied  to  any  coating  system. 


Mode  of  Technology  Transfer 

This  method  of  scribe  undercutting  measurement  will  be  incorporated  into  future 
drafts  of  SSPC  paint  performance  specifications  and  may  also  be  adopted  as  a  test 
method  by  ASTM.  As  SSPC  members  review  this  method,  further  refinements  will 
be  made. 
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2  Testing  Procedures 


Panel  Preparation 

The  coating  systems  used  in  this  study  are  listed  in  Table  1. 


Table  1.  Coating  systems. 


System  Code 

Recommended  DFT  (mils) 

1 .  Epoxy-Polyamide  Coating  system 

Primer:  MIL- P-24441,  Type  IV,  Formula  150 

2.8 

Topcoat:  MIL-P-24441,  Type  IV,  Formula  152 

2.8 

2.  Zinc-Rich  Epoxy  Primer  /  Epoxy  Topcoat  System 

Primer:  Amercoat  68FIS  Zinc  3.0 

3.0 

Topcoat:  Amercoat  385  Multipurpose 

4.0  to  6.0 

3.  Aluminum  filled  Epoxy  Coating  System 

Primer:  Carbomastic  90  Aluminum 

5.0 

Topcoat:  Carbomastic  90  Aluminum 

5.0 

4.  Alkyd  Paint  System 

Primer:  SSPC-Paint  25 

2.0 

2nd:T-T-E-489 

2.5 

Topcoat:  T-T-E-489 

2.5 

5.  Moisture  Cure  Polyurethane  System 

Primer:  Wasser  MC-Zinc 

3.0 

2nd  Wasser  MC-Ferrox  B 

3.0 

Topcoat:  Wasser  MC-Ferrox  A 

3.0 

6.  State  of  Georgia  Waterborne  Bridge  Paint  System  VI 

Primer:  Amercoat  148  (brown) 

3.0 

2nd:Amercoat  220  (white) 

3.0 

Topcoat:  Amercoat  220  (green) 

3.0 

7.  3329  Corps  of  Engineers  Vinyl  System  5-E-Z 

Primer:  VZ-108d 

2.0 

2nd:V-766e  (white) 

2.0 

Topcoat  V-766e  (gray) 

2.0 

8.  3330  Corps  of  Engineers  Vinyl  System  4 

Primer:  V-766e  (white) 

2.0 

2nd:V-766e  (gray) 

2.0 

Topcoat:  V-766e  (gray) 

2.0 

9.  3331  Corps  of  Engineers  Vinyl  System  3-A-Z 

Primer:  VZ-108d 

2.0 

2nd:V-766e  (white) 

2.0 

Topcoat:  V-1 02e  Aluminum 

2.0 
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Mild  hot  rolled  steel  panels  were  blast  cleaned  to  SSPC-SP  5,  White  Metal  Blast 
Cleaning,  with  #24  aluminum  oxide  abrasive.  The  blast  profile  was  measured  using 
Testex  Tape  (ASTM  D  4417,  Method  C;  NACERP0287-95)  to  be  between  1.5  and  2.5 
mils.  Panel  sizes,  given  in  Table  2,  were  typically  3  x  6  x  1/8  inch  (76  x  152  x  3  mm). 
Note  that  Systems  7,  8,  and  9  had  slightly  larger  panels,  3  x  9  x  1/8  inch  (76  x  229  x 
3  mm),  than  the  other  systems.  All  coatings  were  spray  applied  using  conventional 
equipment.  Two  parallel  scribes,  each  about  60  mm  (2.5  inch)  long,  were  scored  at 
an  angle  across  the  face  of  each  test  panel.  The  scribes  were  8  to  10  cm  (3  to  4 
inches)  apart.  The  dry  film  thicknesses  (DFTs)  of  the  panels  are  given  in  Table  3. 

The  test  systems  had  similar,  but  not  exactly  the  same,  test  parameters.  Systems  1 
to  6  had  six  replicate  panels,  and  each  panel  had  two  60+  mm  long  scribes.  Systems 
7,8,  and  9  had  seven  replicate  panels  in  each  set,  and  each  panel  had  two  scribes, 
but  some  of  the  scribes  were  less  than  60  mm.  The  shorter  scribes  had  from  two  to 
six  fewer  data  points.  System  1  had  sets  of  six  panels  at  1680  hours  (10  weeks), 
2688  hours  (16  weeks),  and  3360  hours  (20  weeks)  for  a  total  of  18  panels.  System  6 
had  sets  of  6  panels  at  1680  hours  and  3360  hours  for  a  total  of  12  panels.  The  other 
systems  had  panel  sets  only  at  3360  hours.  The  panel  sets  and  individual  panel  IDs 
are  given  in  Table  2. 


Table  2.  Sets  of  test  panels. 


System 

Panel  ID 

Number  of  Panels 

Panel  Size 

Exposure  Time 

System  1 

1A-F 

6  panels 

3”x6”x1/8 

1680  h  (10  weeks) 

1G-L 

6  panels 

3”x6”x1/8 

2688  h  (16  weeks) 

1  M-R 

6  panels 

3”x6”x1/8 

3360  h  (20  weeks) 

System  2 

2A-F 

6  panels 

3”x6”x1/8 

3360  h 

System  3 

3A-F 

6  panels 

3”x6”x1/8 

3360  h 

System  4 

4A-F 

6  panels 

3”x6”x1/8 

3360  h 

System  5 

5A-F 

6  panels 

3”x6”x1/8 

3360  h 

System  6 

6A-F 

6  panels 

3”x6”x  1/8 

1680  h  (10  weeks) 

6G-L 

6  panels 

3”x6”x1/8 

3360  h 

System  7 

7A-G 

7  panels 

3”x9”x1/8 

3360  h 

System  8 

8A-G 

7  panels 

3”x9”x1/8 

3360  h 

System  9 

9A-G 

7  panels 

3”x9”x1/8 

3360  h 

ERDC/CERL  TR-01-74 
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Table  3.  Total  dry  film  thickness  of  individual  panels. 


Panel 

Exposure 
Time  (h) 

DFT 

Panel 

Exposure 
Time  (h) 

DFT 

mils 

micrometers 

mils 

micrometers 

1680 

6.7 

5A 

3360 

8.9 

226 

mm 

5.0 

5B 

9.6 

244 

mm 

6.1 

5C 

9.0 

229 

ID 

5.4 

5D 

9.5 

241 

IE 

5.8 

147 

5E 

8.8 

224 

IF 

6.0 

152 

5F 

9.2 

234 

1G 

2688 

7.0 

178 

6A 

1680 

6.0 

152 

1H 

5.4 

137 

6B 

7.3 

185 

11 

6.7 

170 

6C 

7.3 

185 

1J 

5.0 

127 

6D 

7.0 

178 

IK 

5.5 

140 

6E 

8.0 

203 

1L 

7.3 

185 

6F 

7.9 

201 

1M 

3360 

6.4 

163 

6G 

3360 

7.0 

178 

mm 

6.0 

152 

6H 

7.6 

193 

BbI 

5.0 

127 

61 

7.7 

196 

BEI 

4.8 

122 

6J 

6.6 

168 

mm 

5.5 

140 

6K 

7.5 

191 

mm 

5.5 

140 

6L 

8.0 

203 

2A 

3360 

8.5 

216 

mm 

3360 

7.7 

196 

2B 

9.7 

246 

msm 

7.6 

193 

2C 

8.5 

216 

8.0 

203 

2D 

9.0 

229 

7D 

7.7 

196 

2E 

7.3 

185 

7E 

7.8 

198 

2F 

11.9 

302 

7F 

7.5 

191 

7G 

7.3 

3A 

3360 

m^m 

330 

8A 

3360 

8.0 

203 

3B 

wsm 

305 

8B 

8.0 

203 

3C 

msm 

406 

8C 

7.7 

196 

3D 

mSm 

368 

8D 

6.8 

173 

3E 

m^m 

305 

8E 

6.9 

175 

3F 

13.0 

330 

8F 

7.2 

183 

8G 

6.8 

4A 

3360 

6.0 

152 

9A 

3360 

8.9 

226 

4B 

6.5 

165 

9B 

8.3 

211 

4C 

5.9 

150 

9C 

8.5 

216 

4D 

6.0 

152 

9D 

8.0 

203 

4E 

6.3 

160 

9E 

8.7 

221 

4F 

6.1 

155 

9F 

8.9 

226 

9G 

8.2 

Exposure  Conditions 

The  panels  were  exposed  for  the  stated  number  of  hours  in  accordance  with  ASTM 
D  5894,  Standard  Practice  for  Cyclic  Salt  Fog/UV  Exposure  of  Painted  Metal,  (Al¬ 
ternating  Exposures  in  a  Fog/Dry  Cabinet  and  a  UV/Condensation  Cabinet).  Spe¬ 
cifically,  a  2-  week  test  cycle  started  with  168  hours  (1  week)  in  a  UV/condensation 
cabinet  followed  by  168  hours  in  a  cyclic  salt  fog  cabinet  (also  known  as  a  prohesion 
cabinet).  The  UV/condensation  cycle  consisted  of  4  hours  of  ultraviolet  exposure 
(UVA  340  lamps)  at  60°C  alternating  with  4  hours  of  condensation  at  50°C.  The  cy¬ 
clic  salt  fog  cycle  was  1  hour  of  fog  (Timmons’  solution)  at  24°C  alternating  with  one 
hour  of  drying  at  35°C. 
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Post-Exposure  Scribe  Preparation 

Prior  to  measurement  of  undercutting  on  systems  1  to  6,  the  scribes  were  scraped 
according  to  the  procedure  described  in  Section  7.2  of  ASTM  D  1654,  Test  Method 
for  Evaluation  of  Painted  or  Coated  Specimens  Subjected  to  Corrosive  Environ¬ 
ments.  This  method  removes  all  coating  near  the  scribe  that  is  not  tightly  adhered. 
The  three  vinyl  systems  (7,  8,  and  9)  were  prepared  according  to  Section  7.1  of 
ASTM  D  1654  and  were  not  scraped. 


Scribe  Measurement  Methods 

Two  methods  were  used  for  evaluating  scribe  undercutting:  Method  1,  where  meas¬ 
urements  were  made  at  5-mm  intervals  along  the  scribe;  and  Method  2,  where  only 
the  maximum  undercutting  for  each  scribe  was  determined. 

Method  1:  Measuring  Scribe  Undercutting  at  5-mm  intervais 

This  method  involved  measuring  the  undercutting  to  the  left  and  to  the  right  of  the 
centerline  at  5-mm  intervals  along  the  length  of  the  scribe.  For  a  60-mm  long  scribe, 
12  measurements  were  made  to  the  left  and  12  to  the  right  for  a  total  of  24  meas¬ 
urements  per  scribe.  Since  each  panel  had  2  scribes,  there  were  48  measurements 
per  panel.  Six  panels  in  a  set  gave  288  data  points  for  each  set. 

Some  of  the  panels  in  Systems  7,  8,  and  9  had  scribes  that  were  less  than  60  mm. 
Since  the  5-mm  spacing  was  maintained,  only  18,  20,  or  22  measurements  were 
taken  for  these  short  scribes.  These  three  systems  also  had  seven  replicates  instead 
of  six.  This  method  can  easily  be  adapted  to  different  scribe  lengths  or  different 
numbers  of  replicate  panels.  The  number  of  data  points  ranged  from  294  for  System 
7  to  334  for  System  9. 

In  order  to  make  the  method  as  objective  as  possible,  a  template,  shown  in  Figure  1, 
was  made  that  could  be  taped  over  the  scribe.  A  rectangular  hole  approximately 
60  mm  X  25  mm  was  cut  into  an  index  card.  Twelve  hash  marks  were  made  5  mm 
apart  down  each  side  of  the  hole.  It  was  often  helpful  to  locate  the  center  of  the 
scribe  and  mark  the  centerline  with  a  utility  knife.  The  template  was  then  centered 
over  the  scribe  and  taped  to  the  panel.  A  ruler  was  aligned  with  the  corresponding 
hash  marks  and  the  extent  of  the  undercutting  from  the  centerline  was  measured 
and  recorded.  A  different  size  template  could  be  used  for  scribes  of  different  length 
or  with  greater  undercutting. 
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Method  2:  Maximum  Undercutting 

The  other  method  to  characterize  a  scrihe  is  to  measure  the  maximum  undercutting 
from  the  center  of  the  scrihe  at  any  point  along  the  scrihe.  One  simply  scans  the 
scrihe  visually  to  locate  the  possible  points  where  the  scrihe  appears  to  he  a  maxi¬ 
mum,  measures  those  points,  and  records  the  maximum  value. 


Figure  1.  Template  used  in  measuring  scribe  undercutting. 
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Performance  Evaluation  Procedures 

ASTM  D  1654  stipulates  recording  of  the  mean,  the  maximum,  and  the  minimum 
undercutting  hut  does  not  give  a  precise  method  for  determining  the  mean.  If  the 
maximum  is  an  isolated  spot  it  should  he  stated  as  such.  The  minimum  scrihe  gives 
information  about  the  range  of  undercutting  hut  does  not  really  say  how  good  the 
coating  is.  There  is  no  single  number  that  adequately  describes  the  scribe.  One  of 
the  objectives  of  this  project  is  to  establish  a  method  to  quantify  scribe  undercut¬ 
ting. 

Statistical  Evaluation  of  Data  From  Method  1 

A  series  of  scribe  undercutting  measurements  can  be  described  in  several  ways.  The 
most  complete  picture  of  the  scribe  would  be  to  look  at  all  288  data  points.  Statisti¬ 
cal  methods  are  used  to  describe  the  scribe  with  fewer  numbers.  Common  statistical 
measurements  of  central  tendency  are  mean,  median,  and  mode.  The  mean  is  the 
arithmetic  average  value:  add  up  the  measurements  and  divide  by  the  number  of 
measurements.  The  median  is  the  measurement  in  the  middle:  half  the  measure¬ 
ments  are  greater  than  the  median  and  half  are  less  than  the  median.  The  mode  is 
the  measurement  that  occurs  most  frequently.  In  an  ideal  normal  distribution, 
these  three  numbers  are  the  same.  For  the  systems  tested  in  this  project,  the  mean, 
the  median,  and  the  mode  were  very  similar. 

The  mean  is  proportional  to  the  total  area  of  undercutting,  but  it  does  not  describe 
the  distribution  of  the  data  or  the  shape  of  the  undercutting.  This  measure  of  dis¬ 
persion  is  given  by  the  range,  the  variance,  or  the  standard  deviation.  The  range  is 
simply  the  difference  between  the  maximum  and  the  minimum  measurements.  The 
range  is  likely  to  increase  as  more  measurements  are  taken  and  it  does  not  describe 
the  shape  of  the  distribution.  Variance  is  a  measure  of  the  variation  among  meas¬ 
urements  that  is  due  to  the  measurement  process  variables.  Measurements  with  a 
small  variance  are  close  together  and  those  with  a  large  variance  are  spread  out. 
The  standard  deviation  for  a  normal  distribution  has  a  quantitative  meaning.  For 
example,  if  the  mean  scribe  undercutting  is  6  mm  and  the  standard  deviation  is 
1  mm,  there  is  a  68%  probability  that  a  measurement  taken  at  random  will  be  be¬ 
tween  5  and  7  mm,  there  is  a  95%  probability  that  the  measurement  will  fall  be¬ 
tween  4  and  8  mm,  and  there  is  a  99%  probability  that  the  measurement  will  fall 
between  3  and  9  mm.  The  larger  the  standard  deviation,  the  more  spread  out  are 
the  data.  An  advantage  of  using  standard  deviation  is  that  it  describes  the  data  dis¬ 
tribution.  Whether  100  data  points  or  600  data  points  are  used,  the  standard  devia¬ 
tion  of  each  set  should  be  about  the  same. 


ERDC/CERL  TR-01-74 


21 


When  evaluating  a  coating  system,  is  the  most  critical  parameter  the  maximum  un¬ 
dercutting  or  the  total  area  (mean)  of  undercutting?  The  method  developed  in  this 
project  considers  hoth  factors.  Suppose  two  scribes  have  the  same  maximum  under¬ 
cutting.  Scrihe  A  has  an  isolated  spot  where  the  undercutting  is  6  mm,  and  every¬ 
where  else  the  undercutting  is  less  than  2  mm.  Scrihe  B  has  nearly  uniform  under¬ 
cutting  of  5  to  6  mm  everywhere.  Clearly,  Scrihe  A  is  better  than  Scribe  B. 
Conversely,  suppose  two  scribes  have  the  same  average  undercutting.  Scribe  C  has 
scribe  undercutting  between  5  and  7  mm  with  an  average  of  6  mm.  Scribe  D  has 
undercutting  from  2  to  10  mm  with  an  average  of  6  mm.  Scribe  C  would  be  better 
than  Scribe  D.  Because  of  the  way  standard  deviation  is  computed,  scribes  that  de¬ 
viate  farthest  from  the  mean  contribute  a  disproportionate  share  to  the  standard 
deviation.  Thus,  the  parameter  used  to  characterize  scribe  undercutting  is  the  mean 
plus  two  standard  deviations.  The  mean  is  proportional  to  the  total  area  of  under¬ 
cutting  and  the  standard  deviation  takes  into  account  the  very  large  undercutting 
measurements. 

The  proposed  method  (Method  1)  is  to:  (1)  treat  all  the  data  (288  measurements) 
from  the  12  scribes  as  a  single  population;  (2)  use  a  calculator  to  compute  the  mean 
and  the  standard  deviation;  (3)  multiply  the  standard  deviation  by  2  and  add  this  to 
the  mean.  The  resulting  figure,  rounded  to  the  nearest  millimeter,  is  the  scribe  pa¬ 
rameter.  If  a  similar  panel  were  chosen  and  a  random  spot  were  picked  along  the 
scribe,  there  would  be  more  than  a  95%  probability  that  the  undercutting  would  be 
less  than  this  number. 

Treating  Maximum  Undercutting  Data  From  Method  2 

When  the  maximum  undercutting  data  are  used,  each  set  of  6  panels  yields  12  data 
points  (14  data  points  for  sets  of  7  panels).  The  scribe  can  be  characterized  by  the 
average  of  these  12  maximum  readings  or  by  the  average  plus  one  or  two  standard 
deviations.  If  these  12  data  points  are  used  to  compute  an  average  and  a  standard 
deviation,  the  average  plus  two  standard  deviations  would  give  an  upper  limit  for 
scribe  undercutting,  a  benchmark.  Assuming  that  the  maximum  undercutting 
measurements  are  normally  distributed,  the  next  scribe  measured  would  have 
greater  than  a  95%  probability  of  having  a  maximum  undercutting  less  than  the 
computed  benchmark.  If  fewer  replicates  were  used,  similar  computations  could  be 
performed,  but  the  standard  deviation  would  most  likely  be  higher.  Also,  using  one- 
fourth  the  number  of  replicates  would  double  the  uncertainty  of  the  mean. 

Another  alternative  method  of  data  treatment  is  to  perform  a  Weibull  analysis  of 
the  12  (or  14)  maximum  undercutting  values.  In  this  report,  this  is  referred  to  as 
Method  2W.  There  are  not  enough  data  in  the  current  set  of  panels  to  show  that  the 
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undercutting  follows  a  Weibull  distribution.  However,  a  Weibull  distribution  could 
be  assumed  and  then  the  computations  performed.  Once  the  Weibull  computation  is 
set  up  in  a  spreadsheet,  whole  number  target  values  are  entered  until  one  is  found 
to  give  a  Weibull  probability  greater  than  95%.  A  Weibull  calculation  can  be  used  to 
determine  the  probability  that  the  scribe  undercutting  will  be  less  than  any  other 
target  value. 
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3  Test  Results 

The  raw  data  for  Method  1  taken  at  5-mm  intervals  along  the  scrihe  are  given  in 
Table  4  for  System  3  and  in  Appendix  A  for  the  other  data  sets.  The  test  panels  are 
identified  hy  the  coating  system  and  the  panel  within  the  set.  For  example,  2C  is 
System  2,  panel  C.  For  ease  of  logging  the  data  onto  the  computer  while  the  meas¬ 
urements  were  being  taken,  the  tables  include  a  “left”  and  a  “right”  column  for  the 
data  on  the  appropriate  side  of  the  centerline.  Each  panel  has  two  scribes.  Data 
from  the  top  scribe  are  numbered  1  to  12  and  the  data  from  the  bottom  scribe  are 
numbered  13  to  24.  Thus,  there  are  48  data  points  for  each  panel.  For  the  analysis, 
all  the  data  for  a  given  set  (288  measurements)  are  lumped  together. 

The  maximum  undercutting  measured  from  the  center  of  the  scribe  at  any  point 
along  the  scribe.  Method  2  data,  are  given  in  Table  5. 
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Table  4.  Scribe  undercutting  (mm)  at  5-mm  intervals  for  System  3. 
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Table  5.  Maximum  undercutting  at  each  scribe,  Method  2. 
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4  Data  Analysis 

Results  of  Method  1 

This  section  will  describe  the  analysis  of  System  3  and  show  some  appropriate  ta¬ 
bles  and  charts.  The  corresponding  tables  and  charts  for  the  other  panel  sets  are 
similar.  Additional  tables  and  charts  for  System  3  and  statistical  parameters  for  the 
other  systems  are  given  in  Appendix  B. 

The  first  step  in  the  analysis  was  to  make  a  frequency  plot  and  to  determine  the  na¬ 
ture  of  the  distribution.  Figure  2,  which  shows  a  histogram  of  the  data  with  a  nor¬ 
mal  distribution  superimposed,  indicates  that  when  all  288  scribe  measurements 
are  lumped  together  to  form  a  single  population,  the  data  closely  resemble  a  normal 
distribution.  Further  indication  that  the  data  are  normally  distributed  is  given  in 
Figure  3,  which  shows  a  comparison  of  the  actual  quantiles  with  those  expected 
from  a  normal  distribution. 


Absolute  Frequencies 


Scribe  Undercutting  (mm) 


Normai 
System  3 


Figure  2.  Histogram  of  System  3  versus  normai  distribution. 


ERDC/CERL  TR-01-74 


27 


20.0 
18.0 
16.0 
?  14.0 

I  12.0 

I  10.0 

I  8.0 

I  6.0 

4.0 
2.0 
0.0 

^-3-2-101234 

Expected  Normal  Quantiles 
Figure  3.  Normal  probability  piot  of  System  3. 


Plot 


Many  different  statistical  parameters  were  computed  from  the  data  collected  using 
Method  1.  These  parameters  along  with  the  associated  tables  and  charts  for  System 
3  are  given  in  Appendix  B.  For  example,  Table  B2  can  be  used  to  find  the  probabil¬ 
ity  that  the  undercutting  at  a  random  point  will  be  less  than  a  given  number;  or 
conversely,  below  what  number  will  95%  of  the  measurements  fall.  Table  B3  lists 
statistical  parameters  for  all  of  the  data  sets.  The  “benchmark”  derived  from  this 
data  is  the  mean  plus  two  standard  deviations.  These  benchmarks  are  listed  in 
Table  6. 


Table  6.  Benchmarks  (scribe  undercutting,  mm)  for  12  data  sets  sorted  by  Method  1. 


System 

Time  (h) 

Generic  Type 

Method  1 

Method  2 

Method  2W 

7 

3360 

3329  Corps  of  Engineers  Vinyl  System  5-E-Z 

3 

4 

5 

9 

3360 

3331  Corps  of  Engineers  Vinyl  System  3-A-Z 

4 

6 

8 

5 

3360 

Moisture  cure  polyurethane  (3  coat) 

4 

6 

6 

8 

3360 

3330  Corps  of  Engineers  Vinyl  System  4 

6 

8 

9 

4 

3360 

Alkyd  (3  coat) 

7 

12 

12 

6 

1680 

State  of  Georgia  waterborne  (3  coat) 

8 

11 

11 

2 

3360 

Zinc-rich  epoxy/epoxy  (2  coat) 

9 

13 

13 

1 

3360 

Epoxy  polyamide  (2  coat) 

10 

13 

13 

6 

3360 

State  of  Georgia  waterborne  (3  coat) 

10 

14 

14 

1 

1680 

Epoxy  polyamide  (2  coat) 

10 

15 

15 

1 

2688 

Epoxy  polyamide  (2  coat) 

11 

15 

16 

3 

3360 

Aluminum  filled  epoxy  (2  coat) 

13 

18 

18 

Method  1 :  Mean  +  two  standard  deviations,  288  (or  more)  data  points. 

Method  2:  Mean  +  two  standard  deviations  of  maximums;  12  (or  14)  data  points. 

Method  2W:  Target  value  such  that  the  Weibull  probability  of  the  maximum  exceeds  95%;  12  (or  14)  data  points. 
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Analysis  of  Maximum  Undercutting  Data  Using  Method  2 
Normal  Probability  Analysis 

The  raw  data  of  maximum  undercutting,  sorted  in  descending  order,  are  given  in 
Table  7.  From  this  data,  grouping  all  measurements  for  a  set  together,  the  mean  or 
average  of  the  maxima  and  the  standard  deviation  were  calculated.  Table  8  lists 
these  values  for  each  of  the  12  data  sets  as  well  as  the  mean  plus  one  or  two  stan¬ 
dard  deviations  and  the  absolute  maximum  measurement. 

Wei  bull  Analysis 

A  Weibull  analysis  was  also  performed  on  the  maximum  undercut  data.  The 
Weibull  analysis  gives  the  probability  that  the  maximum  undercutting  will  be  less 
than  any  target  value.  Since  scribe  measurements  are  only  made  to  the  nearest  mil¬ 
limeter,  whole  number  target  values  were  chosen.  The  target  values,  6,  12,  and  25 
mm,  were  chosen  to  correspond  approximately  to  1/4,  1/2,  and  1  inch.  The  Weibull 
probabilities  for  these  target  values  are  given  in  Table  9  for  each  data  set. 

Another  approach  is  to  find  the  target  value  that  will  give  a  Weibull  probability 
more  than  95%.  This  means  that  there  is  a  95  %  probability  that  an  identical  panel 
will  have  a  scribe  undercutting  less  than  this  target  value.  Whole  number  target 
values  were  substituted  into  the  Weibull  function  until  the  95%  limit  was  exceeded. 
These  95%  targets  are  also  listed  in  Table  7.  Details  of  the  Weibull  computations 
are  given  in  Appendix  C. 

Normal  Probability  Analysis  Using  Fewer  Replicates 

A  variation  of  Method  2  is  to  use  fewer  replicates  to  generate  12  data  points.  Four 
scribes  (two  test  panels)  are  divided  into  thirds  and  then  each  third  is  treated  as  a 
separate  scribe.  The  benchmarks  computed  with  fewer  replicates  are  close  to  the 
benchmark  computed  using  all  12  scribes;  however,  they  are  slightly  smaller  and 
there  is  more  variability.  This  approach  is  examined  in  Appendix  D. 


Table  8.  Maximum  undercutting  (mm)  at  each  scribe,  sorted  by  Method  2. 
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Comparison  of  Methods  of  Evaluating  Scribe  Undercutting 

In  the  search  for  a  number  that  can  he  used  as  a  benchmark  to  describe  scribe  un¬ 
dercutting,  the  three  primary  candidates  are  as  follows. 

Method  1 

Take  many  measurements  (e.g.,  288)  and  use  the  mean  plus  two  standard  devia¬ 
tions. 

Advantages  of  Method  1  are: 

•  Straightforward  and  easy  to  take  measurements 

•  Computations  are  elementary  and  can  be  done  on  a  hand  held  calculator  or 
with  any  computer  statistics  package 

•  Consideration  is  given  to  the  shape  of  the  scribe  undercutting;  total  area  of 
undercutting  as  well  as  rogue  peaks  contribute  to  the  final  number. 

Disadvantages  of  Method  1  are: 

•  Time  consuming  to  make  and  record  288  measurements 

•  Easy  to  miss  narrow  peaks 

•  Some  subjective  judgments  must  be  made,  especially  for  non-uniform  scribes. 

Method  2 

Measure  only  the  maximum  undercutting  on  each  scribe  (12  measurements)  and 
use  the  mean  plus  two  standard  deviations. 

Advantages  of  Method  2  are: 

•  Straightforward  and  easy  to  take  measurements 

•  Short  time  required  to  make  and  record  12  measurements 

•  Very  objective,  little  judgment  required 

•  Computations  are  elementary  and  can  be  done  on  a  hand  held  calculator  or 
with  any  computer  statistics  package 

•  The  maximum  undercutting  is  definitely  measured. 


ERDC/CERL  TR-01-74 


31 


Disadvantages  of  Method  2  are: 

•  No  consideration  is  given  to  the  total  area  of  the  scrihe  undercutting;  a  rogue 
peak  exerts  a  disproportionate  weight  on  the  computation 

•  Small  data  set  increases  statistical  uncertainty. 

Method  2W 

Measure  only  the  maximum  undercutting  on  each  scrihe  (12  measurements)  and 
use  Weihull  analysis  to  compute  the  target  undercutting  at  95%  confidence. 

Advantages  of  Method  2W  are: 

•  Straightforward  and  easy  to  take  measurements 

•  Short  time  required  to  make  and  record  12  measurements 

•  Very  objective,  little  judgment  required 

•  The  maximum  undercutting  is  definitely  measured. 

Disadvantages  of  Method  2W  are: 

•  No  consideration  is  given  to  the  total  area  of  the  scrihe  undercutting;  a  rogue 
peak  exerts  a  disproportionate  weight  on  the  computation 

•  Computations  are  more  complicated  and  are  not  supported  hy  all  statistics 
software 

•  Small  data  set  increases  statistical  uncertainty. 

The  possible  benchmarks  using  the  3  methods  discussed  above  are  listed  in  Table  8 
for  each  of  the  12  data  sets. 

The  benchmarks  computed  by  Methods  1  and  2  have  a  close  linear  relationship,  as 
can  be  seen  in  Figure  4.  The  Method  2  benchmarks  are  higher  than  those  of  Method 
1  because  they  are  based  on  the  absolute  maximum  undercutting  for  each  scribe 
rather  than  undercutting  at  a  random  position. 
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Figure  4.  Comparison  of  Methods  1  and  2  for  benchmarking. 

There  is  almost  identical  agreement  between  Methods  2  and  2W  (Figure  5).  Of  the 
12  data  sets,  9  were  identical  (rounded  to  the  nearest  millimeter),  2  differed  by 
1  mm,  and  only  system  9  differed  by  2  mm.  The  benchmark  calculated  by  Method  2 
is  simply  the  average  maximum  plus  two  standard  deviations.  The  computation 
could  be  performed  very  easily  on  a  hand  held  calculator,  as  only  12  (or  14)  data  en¬ 
tries  are  required.  This  is  in  contrast  to  the  more  complicated  Weibull  analysis. 
Method  2W. 


Figure  5.  Comparison  of  Methods  2  and  2W  for  benchmarking. 
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Looking  at  the  benchmarks  for  System  1  it  becomes  apparent  that  there  was  a  re¬ 
versal  of  the  data  from  what  would  normally  be  expected.  It  is  impossible  for  the 
scribes  to  be  worse  at  shorter  exposure  times  than  at  longer  times.  If  the  identical 
panels,  rather  than  replicate  sets,  were  measured  at  different  times,  this  reversal  in 
undercutting  would  not  occur.  Two  possible  explanations  are:  (1)  this  discrepancy 
may  be  due  to  variations  in  the  panel  preparations,  position  within  the  test  cabinet, 
or  some  other  experimental  factor  or  (2)  the  variation  is  within  the  range  of  preci¬ 
sion  of  the  measurement  technique  and  that  the  rate  of  undercutting  was  greatest 
during  the  first  1680  hours  of  exposure.  As  discussed  in  a  later  section,  DFT  varia¬ 
tions  are  not  responsible  for  the  reversal. 


Reproducibility  of  Results 

In  order  to  test  the  intralaboratory  reproducibility  of  the  scribe  evaluation  methods. 
Systems  2  and  3  were  measured  by  two  other  observers  in  the  same  laboratory. 
They  were  also  remeasured  by  the  principal  observer.  The  raw  data  for  Method  1 
are  given  in  Appendix  A  and  for  Method  2  in  Table  9.  System  3  was  chosen  because 
most  of  the  discussion  in  the  report  focuses  on  System  3.  System  2  was  chosen  be¬ 
cause  the  scribe  undercutting  is  not  as  uniformly  smooth  as  that  for  System  3. 
There  are  more  isolated  blisters  along  most  of  the  System  2  scribes. 

The  statistical  computations  or  descriptive  estimates  based  on  each  set  of  288 
measurements  (Method  1)  are  listed  in  Table  10.  Each  set  of  measurements  very 
closely  fits  a  normal  distribution.  The  mean  undercutting  for  these  four  measure¬ 
ments  differs  by  less  than  a  mil  (25  micrometers)  and  the  other  statistics  are  also 
very  similar  to  each  other.  When  the  template  is  taped  to  the  panel  prior  to  taking 
the  measurements,  it  is  randomly  positioned  along  the  scribe  as  long  as  24  meas¬ 
urements  can  be  taken.  It  is  unlikely  that  the  template  would  be  in  exactly  the 
same  position  for  two  different  data  sets.  Nonetheless,  the  method  is  sufficient  to 
achieve  uniform  results  among  different  observers. 

The  benchmarks  computed  from  the  data  of  the  different  observers  for  Method  1, 
Method  2,  and  Method  2W  are  compared  in  Table  11.  The  data  clearly  show  that  the 
benchmarks  are  consistent  among  different  observers.  Weibull  statistics  (Method 
2W)  gives  benchmarks  that  are  a  little  higher  than  those  computed  assuming  a 
normal  distribution  (Method  2) . 
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Table  10.  Selected  statistical  parameters  for  Method  1  data  taken  by  different  observers  for 
Systems  2  and  3. 


System  -> 

2 

3 

Observer  -> 

1 

1* 

2 

3 

1 

1* 

2 

3 

Statistic 

#  of  data  points 

288 

288 

288 

288 

288 

288 

288 

288 

Minimum 

1 

1 

0 

0 

1 

1 

1 

1 

Maximum 

11 

11 

11 

11 

15 

15 

15 

15 

Range 

10 

10 

11 

11 

14 

14 

14 

14 

Median 

6 

6 

6 

6 

7 

8 

7 

7 

90th  percentile 

8 

8 

8 

8 

11 

12 

10 

11 

95th  percentile 

9 

9 

9 

9 

12 

13 

12 

13 

Mean 

5.6 

6.0 

5.3 

5.7 

7.1 

7.9 

6.9 

7.3 

Upper  95%  C.l. 

5.8 

6.2 

5.6 

5.9 

7.4 

8.3 

7.2 

7.6 

Upper  99%  C.l. 

5.9 

6.2 

5.7 

6.0 

7.5 

8.4 

7.3 

7.7 

Variance 

3.7 

3.2 

5.3 

3.8 

8.0 

7.3 

7.2 

7.3 

Standard  deviation 

1.9 

1.8 

2.3 

2.0 

2.8 

2.7 

2.7 

2.7 

Coet  of  variation 

0.3 

0.3 

0.4 

0.3 

0.4 

0.3 

0.4 

0.4 

Standard  error 

0.1 

0.1 

0.1 

0.1 

0.2 

0.2 

0.2 

0.2 

t-value  (mean=0) 

49.312 

56.865 

38.957 

49.293 

42.493 

49.820 

43.655 

45.957 

Mean  abs.  dev. 

1.5 

1.4 

1.9 

1.5 

2.3 

2.1 

2.1 

2.1 

Skewness 

-0.0198 

-0.0101 

-0.3665 

-0.1577 

0.3236 

0.1831 

0.4261 

0.3007 

Kurtosis 

0.1267 

-0.1405 

-0.3091 

0.2826 

-0.2100 

-0.0820 

0.3228 

-0.0728 

*  Remeasured  by  Observer  1 . 


Table  11.  Comparison  of  scribe  undercutting  benchmarks  (mm)  determined  by  different 
observers. 


System  2 

System  3  | 

Observer  -> 

1 

1* 

2 

3 

1 

1* 

2 

3 

Method  1  (288  data  points) 

9 

10 

10 

10 

13 

13 

12 

13 

Method  2  (12  data  points) 

13 

13 

13 

13 

18 

18 

17 

17 

Method  2W  (12  data  points) 

13 

14 

14 

13 

18 

19 

19 

18 

*  Remeasured  by  Observer  1 . 


ANOVAfor  Panels  of  System  3 

Method  1  involved  taking  24  measurements  on  each  scrihe  or  48  measurements  per 
panel  and  then  lumping  them  all  together  into  a  single  population  of  288  data 
points.  This  section  examines  the  panel-to-panel  variation  within  System  3.  The 
raw  data  for  the  six  panels  of  System  3  are  given  in  Table  4.  The  two  scribes  on  a 
panel  form  one  data  set.  Statistical  computations  were  run  for  each  panel  and  are 
summarized  in  Table  12.  Except  for  panel  3B,  data  from  the  individual  panels  agree 
with  each  other  and  with  the  overall  computations.  ANOVA  confirms  what  appears 
obvious  from  the  raw  data  that  panel  3B  is  different  from  the  others.  Table  13  is  the 
t-Test  pairwise  comparisons.  Figure  6  is  a  plot  of  means  and  intervals  of  the  six 
panels  from  System  3  and  clearly  shows  panel  3B  to  be  an  outlier.  Both  of  these 
analyses  indicate  Panel  3B  is  statistically  different  from  the  other  five  panels. 
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Table  12.  Descriptive  estimates  of  scribe  undercutting  for  System  3  panels. 


Panel  #  -> 

3A 

3B 

3C 

3D 

3E 

3F 

ALL 

STATISTIC 

#  of  data  points 

48 

48 

48 

48 

48 

48 

288 

Minimum 

2 

1 

2 

3 

2 

2 

1 

Maximum 

14 

10 

13 

13 

15 

14 

15 

Range 

12 

9 

11 

10 

13 

12 

14 

Median 

8 

5 

7 

7 

7.5 

7 

7 

90th  percentile 

11 

8 

10 

11 

11 

12 

11 

95th  percentile 

14 

9 

12 

13 

13 

14 

12 

Mean,  x’ 

7.9 

4.7 

7.3 

7.4 

7.8 

7.6 

7.1 

Upper  95%  C.l. 

8.8 

5.4 

7.9 

8.1 

8.5 

8.5 

7.4 

Upper  99%  C.l. 

9.1 

5.6 

8.1 

8.3 

8.8 

8.8 

7.5 

Variance 

9.1 

4.6 

5.3 

6.5 

6.7 

9.7 

8.0 

Standard  deviation,  s 

3.0 

2.1 

2.3 

2.6 

2.6 

3.1 

2.8 

Coef.  of  variation 

0.382 

0.453 

0.318 

0.348 

0.332 

0.411 

0.399 

Standard  error 

0.436 

0.309 

0.332 

0.369 

0.373 

0.449 

0.167 

t-value  (mean=0) 

18.1 

15.3 

21.8 

19.9 

20.9 

16.9 

42.5 

Mean  abs.  dev. 

2.4 

1.6 

1.8 

2.1 

2.0 

2.5 

2.3 

Skewness 

-0.11 

0.27 

0.16 

0.50 

0.40 

0.59 

0.32 

Kurtosis 

-0.49 

-0.08 

0.02 

-0.38 

0.34 

-0.45 

-0.21 

x’  +  2s 

14 

9 

12 

12 

13 

14 

13 

Taking  1  measurement  of  maximum  per  scribe 

Max  (top  scribe) 

14 

8 

9 

13 

15 

15 

Max  (bottom  scribe) 

14 

9 

16 

13 

11 

12 

Absolute  max 

14 

9 

16 

13 

15 

15 

16 

Maximum  Scribe  Undercutting  (rounded  up  to  the  nearest  millimeter)  with  at  Least  95%  Weibull 

Probability 


18 


Table  13.  T-test  correlated  groups  (pairwise  comparisons)  for  System  3  panels. 


3A 

3B 

3C 

3D 

3E 

3F 

3A 

0 

6.323012tt 

1.142113 

0.978312 

0.216614 

0.529586 

3B 

6.323012tt 

0 

5.354732tt 

5.379113tt 

5.876001  tt 

4.816532tt 

3C 

1.142113 

5.354732tt 

0 

0.219413 

1.18432 

0.554585 

3D 

0.978312 

5.379113tt 

0.219413 

0 

0.91319 

0.36931 

3E 

0.216614 

5.87600ltt 

1.18432 

0.91319 

0 

0.362731 

3F 

0.529586 

4.816532tt 

0.554585 

0.36931 

0.362731 

0 

tt  p<0.01;t  p<0.05 
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Figure  6.  Correlated  t-test  comparisons  for  System  3. 


Effect  of  Dry  Film  Thickness 


Table  14  lists  the  DFT  for  each  panel  of  System  3  as  well  as  several  different  meas¬ 
urements  of  scribe  undercutting.  For  ease  of  comparison,  the  data  are  sorted  accord¬ 
ing  to  increasing  DFT.  It  is  clear  from  Table  14  that  none  of  the  parameters  corre¬ 
late  with  DFT.  Running  a  correlation  program  confirms  this  observation. 


Table  14.  Comparison  of  DFT  with  scribe  measurements  (mm)  for  individual  panels  of  System  3 
(sorted  by  DFT). 


Panel 

DFT 

Absolute  max 
undercutting 

Mean  x' 

Std.  Dev.  (s) 

95th  percentile 

Benchmark  Method 

1 

3B 

12.0 

9 

5 

2.1 

9 

9 

3E 

12.0 

15 

8 

2.6 

13 

13 

3A 

13.0 

14 

8 

3.0 

14 

14 

3F 

13.0 

15 

8 

3.1 

14 

14 

3D 

14.5 

13 

7 

2.6 

13 

12 

3C 

16.0 

16 

7 

2.3 

12 

12 

It  can  be  reasonably  assumed  that,  for  the  panels  investigated  in  this  study  of  scribe 
undercutting,  variations  in  the  dry  film  thickness  do  not  have  a  statistically  signifi¬ 
cant  effect  on  any  of  the  parameters  used  to  measure  scribe  undercutting.  The  DFT 
data  for  all  of  the  panels  for  each  coating  system  are  given  in  Table  3. 

The  reversal  in  performance  as  a  function  of  time  for  System  1  cannot  be  explained 
with  DFT  variations.  Table  15  gives  average  DFT  for  the  three  batches  of  System  1 
panels  which  were  exposed  for  1680,  2688,  or  3360  hours.  The  panels  exposed  for 
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the  longest  time  had  the  smallest  undercutting.  The  undercutting  of  the  3360  h 
panels  is  less  than  that  for  the  1680  h  panels  even  though  their  DFTs  are  about  the 
same.  Based  on  DFT  alone,  one  might  expect  the  thickest  panels  (2688  h)  to  have 
the  least  undercutting,  hut  the  opposite  is  true.  Clearly,  factors  other  than  DFT  are 
the  cause  of  the  unexpected  behavior  of  System  1. 


Table  15.  DFT  vs  scribe  undercutting  (mm)  for  System  1  for  three  exposure  times. 


Exposure  Time 

Average  DFT 

Mean,  x’ 

Absolute 

Benchmark 

Benchmark 

Benchmark 

(hours) 

(mils) 

(mm) 

max 

Method  1 

Method  2 

Method  2W 

1680 

5.8 

4.6 

16 

10 

15 

15 

2688 

6.2 

5.1 

16 

11 

15 

16 

3360 

5.5 

5.0 

12 

10 

13 

13 
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5  Conclusions 


The  trend  today  in  the  coating  industry  is  to  write  performance  specifications  in¬ 
stead  of  composition  specifications.  The  cychc  salt  fog/UV  condensation  test,  ASTM 
D  5894,  has  become  the  most  highly  regarded  accelerated  laboratory  test  to  evalu¬ 
ate  coating  systems.  Scribe  undercutting  is  the  primary  mode  of  degradation  in  this 
test.  The  problem  was  to  quantify  the  scribe  undercutting  and  to  establish  a 
pass/fail  benchmark. 

This  project  had  two  main  objectives:  (1)  develop  a  rigorous  method  for  evaluating 
and  interpreting  rust  undercutting  data  and  (2)  report  on  performance  “benchmark¬ 
ing”  experiments  conducted  on  these  coating  systems. 


Measuring  Scribe  Undercutting 

In  order  to  achieve  the  first  objective  it  was  necessary  to  develop  a  standard  method 
of  measuring  the  extent  of  scribe  undercutting.  Ideally,  the  method  should  possess 
the  following  properties: 

•  The  method  should  be  straightforward  and  easy  to  use  without  the  need  for 
sophisticated  tools  such  as  electronic  scanners. 

•  The  method  should  be  accurate  and  minimize  subjective  judgments  of  the 
evaluator. 

•  The  method  should  have  enough  sensitivity  to  differentiate  among  coating 
systems  with  different  levels  of  performance. 

•  The  method  should  be  reproducible. 

•  Computations  should  be  able  to  be  performed  on  any  commercial  statistics 
software  package  or  even  on  a  hand  held  calculator. 

Two  methods  of  measuring  scribes,  each  possessing  the  properties  mentioned  above, 
were  examined.  Method  1  involved  measuring  the  undercutting  on  both  sides  of  the 
scribe  at  5-mm  intervals  along  the  scribe.  For  panel  sets  with  12  scribes,  this  re¬ 
sulted  in  288  data  points  for  each  coating  system  exposed  for  a  given  time.  Method  2 
involved  only  12  measurements,  the  maximum  undercutting  for  each  of  the  12 
scribes. 
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In  order  to  achieve  the  second  objective  it  was  necessary  to  describe  the  scribe  un¬ 
dercutting  with  a  number,  a  benchmark.  One  approach,  using  the  288  data  points 
acquired  with  Method  1,  was  to  describe  the  scribe  by  the  average  undercutting  or 
other  measure  of  central  tendency.  The  average  undercutting  is  proportional  to  the 
total  undercut  area  near  the  scribe.  However,  if  the  coating  does  not  undercut  uni¬ 
formly  along  the  length  of  the  scribe,  the  average  will  not  be  a  good  measure  of  the 
ability  of  the  coating  to  protect  at  the  scribe.  In  this  case  the  maximum  undercut¬ 
ting  may  be  a  more  appropriate  measurement.  On  the  other  hand,  a  coating  that 
has  only  one  point  with  a  large  undercutting  will  have  the  same  maximum  under¬ 
cutting  as  a  coating  with  a  uniform  scribe  with  that  same  large  undercutting.  Thus, 
a  method  incorporating  both  of  these  two  measures  is  probably  more  indicative  of  a 
coating’s  performance  at  the  scribe.  A  benchmark  that  incorporates  both  of  these 
tendencies  is  the  mean  plus  two  standard  deviations.  The  mean  is  a  measure  of  the 
average  undercutting  and  any  extraordinarily  large  point  of  undercutting  will  cause 
an  increase  in  the  standard  deviation.  If  a  similar  panel  were  chosen  and  a  random 
spot  were  picked  along  the  scribe,  there  would  be  more  than  a  95%  probability  that 
the  undercutting  would  be  less  than  this  Method  1  benchmark. 

The  second  objective  was  also  achieved  by  computing  a  benchmark  from  the  12  data 
points  measured  using  Method  2.  The  benchmark  is  the  average  plus  two  standard 
deviations  of  these  12  maximum  readings.  There  would  be  more  than  a  95%  prob¬ 
ability  that  the  next  scribe  would  have  a  maximum  undercutting  less  than  this 
Method  2  benchmark. 


Scribe  Measurement  Methods 

Two  acceptable  methods  for  measuring  scribes  have  been  defined.  Scribe  undercut¬ 
ting  can  be  quantitatively  measured  with  reasonable  precision  by  either  measuring 
undercutting  at  5-mm  intervals  along  the  scribe.  Method  1,  or  by  measuring  the 
maximum  undercutting  wherever  it  occurs  on  the  scribe.  Method  2. 

•  Method  1:  Undercutting  was  measured  on  both  sides  of  the  scribe  at  5-mm 
intervals  along  the  scribe.  A  spacing  of  5  mm  was  adequate  to  describe  the 
undercutting.  The  method  was  tedious  in  that  288  or  more  measurements 
were  made.  The  mean  plus  two  standard  deviations  provided  a  benchmark  to 
evaluate  the  coating  system.  Using  six  panels  with  two  scribes  per  panel  pro¬ 
vided  adequate  replication  to  compensate  for  a  rogue  panel. 

•  Method  2:  The  maximum  undercutting  on  each  scribe  was  measured.  With  2 
scribes  per  panel  and  6  replicates,  there  were  12  data  points.  The  average 
plus  two  standard  deviations  provided  a  benchmark.  There  is  a  greater  than 
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95%  probability  that  the  maximum  undercutting  of  the  next  scribe  will  fall 
below  this  benchmark. 

•  Method  2W:  This  method  uses  the  same  12  data  points  as  Method  2  except 
the  95%  target  or  benchmark  is  computed  using  Weibull  analysis.  The 
benchmark  computed  with  Method  2W  was  nearly  the  same  as  the  bench¬ 
mark  computed  with  Method  2  for  the  panel  sets  used  in  this  project.  The  2W 
benchmark  was  about  5%  higher. 

Method  1  has  some  advantages  and  some  disadvantages.  The  biggest  advantage  is 
that  it  is  an  objective  method  and  is  easy  to  use.  However,  there  are  situations 
where  judgment  must  be  used.  If  the  hash  mark  lines  up  with  the  edge  of  a  bubble, 
a  slight  change  in  the  alignment  can  easily  lead  to  a  difference  of  2  mm  in  that  par¬ 
ticular  scribe  undercutting  measurement.  Another  disadvantage  of  the  method  is 
that  the  hash  marks  may  not  line  up  with  the  maximum  undercutting.  Because  so 
many  measurements  are  made  (288),  it  is  probable  that  at  least  some  of  the  meas¬ 
urements  will  approximate  the  maximum.  If  there  are  only  a  few  places  along  the 
scribe  with  substantial  undercutting,  and  if  these  areas  are  not  very  wide,  the 
method  may  lose  some  of  its  validity.  This  method  would  not  be  applicable  to  fili¬ 
form  corrosion. 

Some  of  these  drawbacks  could  be  overcome  by  taking  measurements  at  smaller  in¬ 
tervals,  such  as  every  2  mm.  However,  doing  this  would  dramatically  increase  the 
number  of  data  points  and  the  effort  involved  in  characterizing  the  scribe.  For  the 
paint  systems  examined  in  this  study,  a  5-mm  interval  seemed  to  be  a  reasonable 
choice. 

Method  2,  measuring  the  maximum  undercutting  from  the  center  of  the  scribe  at 
any  point  along  the  scribe,  is  the  simplest  and  most  objective  method  to  characterize 
a  scribe.  One  simply  scans  the  scribe  visually  to  locate  the  possible  points  where  the 
scribe  appears  to  be  a  maximum,  measures  those  points,  and  records  the  maximum 
value.  The  biggest  disadvantage  of  this  method  is  that  it  does  not  describe  the  dis¬ 
tribution  of  the  undercutting.  For  example,  a  scribe  with  no  appreciable  undercut¬ 
ting  except  for  a  single  spot  of  8  mm  will  have  the  same  maximum  undercutting 
value  as  a  scribe  that  is  undercut  6  to  8  mm  along  its  entire  length.  This  situation 
did  not  occur  for  the  test  panels  of  this  study. 

There  was  a  strong  linear  correlation  between  the  benchmarks  computed  by  Method 
1  and  those  computed  by  Method  2.  Thus,  if  one  of  the  benchmarks  were  known,  the 
other  corresponding  benchmark  could  be  easily  found  from  the  regression  equation. 
Taking  288  measurements  according  to  Method  1  provided  essentially  the  same  in¬ 
formation  as  taking  only  12  measurements  according  to  Method  2. 
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Preferred  Benchmark  Method 

When  all  factors  are  considered,  the  recommended  method  for  computing  a  bench¬ 
mark  for  evaluating  scrihe  undercutting  is  Method  2.  Taking  measurements  was 
easy,  reproducible,  and  objective.  The  statistical  computations  were  straightforward 
and  could  be  done  on  a  hand  held  calculator.  For  the  variety  of  systems  tested,  there 
were  no  isolated  points  with  unusually  large  undercutting  that  would  tend  to  skew 
the  measurement  of  an  absolute  maximum  undercutting.  The  strong  linear  correla¬ 
tion  between  the  Method  2  benchmark  and  the  Method  1  benchmark  means  that  no 
needed  information  is  gained  by  collecting  scribe  data  with  the  more  tedious  Method 
1.  The  Method  2  benchmark  is  understandably  higher  than  the  Method  1  bench¬ 
mark  since  the  Method  2  data  include  only  the  maximum  undercutting. 


Replication 

The  six  individual  System  3  panels  were  analyzed  separately  and  then  compared 
with  each  other  in  Chapter  4.  The  fact  that  one  panel  can  be  so  different  from  the 
others  supports  the  need  for  more  than  two  or  three  replicates.  Statistical  analyses 
can  be  performed  on  any  data  set,  but  enough  replicates  are  needed  to  guard 
against  the  effect  of  rogue  panels  such  as  panel  3B.  Since  the  mean  of  panel  3B  is 
more  than  three  standard  deviations  from  the  mean  of  the  others  (outside  the  99% 
confidence  interval),  an  argument  can  be  made  for  ignoring  the  panel  3B  data.  If 
only  two  or  three  replicates  were  used,  it  would  be  difficult  to  identify  panel  3B  as 
the  rogue  panel. 
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6  Recommendations  and  Future  Work 


Prescribed  Procedures 

Based  on  the  various  methods  used  to  gather  and  analyze  data  in  this  project,  gen¬ 
eral  procedures  are  proposed  for: 

•  deriving  a  benchmark  for  scrihe  undercutting 

•  evaluating  a  candidate  system  against  the  benchmark. 

The  procedures  described  below  are  starting  points  that  will  probably  require  some 

modification  after  they  are  put  into  practice. 

Proposed  Method  for  Deriving  a  Benchmark  for  Scribe  Undercutting 

1.  Prepare  replicate  test  specimens  of  the  coating  system  to  be  benchmarked. 

2.  Scribe  each  of  the  panels  in  accordance  with  standard  procedures. 

3.  Identify  12  separate  scribes  or  scribe  segments  of  at  least  20  mm  in  length.  The 
replicates  must  provide  a  minimum  of  four  scribed  areas  of  at  least  60  mm  each. 

4.  Expose  the  test  specimens  for  which  a  performance  benchmark  is  sought  in  a 
cabinet  or  environment  conforming  to  ASTM  D  5894.  A  minimum  duration  is  five 
cycles  (10  weeks  or  1680  hours). 

5.  Measure  the  maximum  undercutting  at  each  of  the  scribes  or  scribe  segments. 

6.  Compute  the  mean  and  standard  deviation  for  each  coating  system.  The  bench¬ 
mark  is  the  mean  plus  two  standard  deviations. 

Proposed  Method  for  Evaiuating  a  Candidate  System  Against  the  Benchmark 

1.  Prepare  replicate  test  specimens  of  the  candidate  coating  system. 

2.  Scribe  each  of  the  panels  in  accordance  with  standard  procedures.  A  minimum  of 
two  test  specimens  and  four  scribed  areas  of  at  least  60  mm  each  is  required. 

3.  Expose  the  replicate  specimens  in  the  test  cabinets  for  the  prescribed  time  and 
test  parameters. 

4.  Measure  scribe  in  accordance  with  procedure  above. 
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5.  Compute  the  average  and  standard  deviation  of  the  maximum  undercutting  of 
the  scrihe  segments.  These  parameters  must  he  comparable  to  previously  estab¬ 
lished  benchmarks. 

Note:  Additional  criteria  can  be  established  for  an  alternate  number  of  measure¬ 
ments. 

This  project  has  defined  adequate  methods  to  measure  scribe  undercutting  and  has 
defined  viable  methods  to  compute  benchmarks.  There  is  still  a  need  to  determine 
the  variability  of  the  exposure  test  (ASTM  D  5894)  including  variability  caused  by 
panel  preparation,  consistency  of  coating  formulations,  and  so  on.  After  the  level  of 
variability  inherent  in  panel  preparation  and  exposure  is  determined,  pass/fail  tar¬ 
gets  based  on  the  benchmarks  for  each  coating  type  can  be  more  accurately  estab¬ 
lished. 


Use  of  Benchmarks  in  Coating  Specifications 
Accelerated  Laboratory  Tests 

A  problem  in  writing  performance  specifications  for  coatings  is  to  determine 
pass/fail  criteria.  The  number  chosen  should  be  based  on  experimental  data  rather 
than  a  “gut  feeling”  for  an  acceptable  benchmark.  The  coating  systems  examined  in 
this  project  represent  the  range  of  generic  systems  most  commonly  used  in  industry. 
The  test  systems  also  have  a  history  of  good  performance  in  industrial  applications. 
For  System  2,  zinc-rich  epoxy  primer/epoxy  topcoat,  the  Method  1  benchmark  was 
10  mm  and  the  Method  2  benchmark  was  13  mm.  For  example,  a  performance  speci¬ 
fication  for  this  type  of  coating  system  could  require  scribe  undercutting  after  3360 
hours  (20  weeks)  exposure  in  ASTM  D  5894  to  be  less  than  15  mm  as  measured  by 
Method  2.  If  the  test  coating  met  this  requirement,  there  would  be  a  high  likelihood 
of  having  performance  at  least  as  good  as  the  zinc-rich  epoxy  system  examined  in 
this  study.  The  target  of  15  mm  instead  of  13  mm  would  allow  for  fluctuations  in  the 
panel  preparation  and  other  testing  conditions.  The  System  1  data  suggest  a  varia¬ 
tion  between  separate  but  similar  data  sets  on  the  order  of  10  to  20%.  As  more  coat¬ 
ings  are  tested  according  to  this  criterion,  the  target  could  be  adjusted  up  or  down  to 
accommodate  experience  and  the  state  of  the  technology. 

Field  Tests 

There  is  no  reason  these  methods  of  evaluating  scribe  undercutting  could  not  be 
used  for  panels  on  a  test  fence  in  order  to  evaluate  coating  performance  in  atmos- 
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pheric  exposures  typically  affecting  infrastructure  such  as  service  bridges,  light 
poles,  cranes,  etc.  For  each  generic  coating  system,  benchmarks  would  have  to  be 
determined  for  different  atmospheric  exposure  conditions  such  as  heavy  industrial, 
light  industrial,  or  marine. 


Miscellaneous  Recommendations 

It  is  the  authors’  opinion  that  scraping  does  not  make  it  easier  to  determine  the  ex¬ 
tent  of  scribe  undercutting.  In  fact,  when  panel  2F  was  re-measured,  the  maximum 
undercutting  was  found  to  be  13  mm  compared  to  10  mm  for  the  initial  measure¬ 
ment  made  weeks  earlier.  The  reason  for  this  3  mm  discrepancy  was  that  all  the 
blistered  paint  was  not  removed  during  the  scraping.  This  was  not  noticed  the  first 
time.  If  no  scraping  had  been  done,  the  observer  would  have  been  more  alert  to  this 
undercutting. 

Another  disadvantage  to  scraping  that  became  apparent  during  the  scribe  meas¬ 
urement  was  that  the  scraping  made  it  difficult  to  determine  the  extent  of  undercut¬ 
ting  when  intact  paint  was  removed.  Ideally,  intact  paint  should  not  have  been  re¬ 
moved,  but  it  was. 


Future  Work 

There  are  other  promising  methods  of  generating  scribe  data  that  have  not  been  ex¬ 
amined  in  this  project  but  may  prove  to  be  viable.  The  data  may  then  be  interpreted 

in  several  different  manners. 

Additional  Statistical  Analysis  of  Current  Panels 

Additional  methods  to  be  evaluated  include  the  following: 

•  Measure  maxima  and  average  at  additional  increments  (e.g.,  every  10  mm)  to 
determine  the  sensitivity  of  the  analysis  to  the  number  of  data  points. 

•  Determine  the  influence  of  shape  and  size  (e.g.,  number  of  measurements  on 
the  precision  of  the  test  method).  This  would  help  to  confirm  the  validity  of 
the  proposed  method  for  establishing  a  benchmark. 
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Determine  Interlaboratory  Reproducibility  of  the  Test  Procedures 

The  reproducibility  of  the  entire  process  needs  to  be  determined  with  a  ‘round-robin’ 
type  of  testing  program.  This  would  entail  preparing  test  panels  and  exposing  them 
in  cyclic  cabinets  in  various  labs  e.g.,  from  testing  organizations  or  paint  manufac¬ 
turers.  Those  would  be  administered  from  ASTM-SSPC  protocols.  Identical  sets  of 
panels  have  been  coated  with  industrial  maintenance  coatings  and  are  waiting  for 
distribution  to  various  laboratories  by  ASTM  Committee  DOl.27.31. 

The  precision  of  the  method  must  be  known  to  avoid  setting  the  target  too  low 
(thereby  eliminating  good  coatings)  or  too  high  (passing  inferior  coatings).  For  ex¬ 
ample,  the  benchmarks  for  System  2  were  10  mm  for  Method  1  and  13  mm  for 
Method  2.  How  much  leeway  should  be  given  for  experimental  error?  Should  the 
target  for  Method  2  be  set  at  13,  15,  or  20  mm?  This  project  has  determined  the 
scale  or  magnitude  of  undercutting  to  be  expected,  it  has  determined  the  precision 
of  the  measurement  method,  but  it  has  not  determined  the  precision  of  the  acceler¬ 
ated  test  method. 

Analyze  History  of  SSPC  and  Other  Files 

Historical  data  in  the  archives  of  SSPC,  CERL,  and  others  could  be  examined  to 
better  define  the  benchmarks  for  these  coating  systems,  both  for  exterior  atmos¬ 
pheric  exposures  and  for  exposures  in  test  cabinets.  The  testing  conditions  under 
which  the  panels  were  exposed  would  need  to  be  closely  scrutinized.  In  general,  the 
SSPC  data  would  not  have  the  same  degree  of  replication  that  this  study  provided. 
However,  one  SSPC  test  used  30  replicates  at  Kure  Beach  and  in  various  immersion 
and  fog  tests  with  panels  coated  with  two  or  three  coats  of  MIL-P-24441  epoxy  (Sys¬ 
tem  1  in  this  project).  This  was  reported  in  SSPC  Publication  90-02,  Performance 
Testing  of  Marine  Coatings:  New  Test  and  Evaluation  Procedures.  SSPC  has  field 
exposure  data  for  the  same  generic  coating  systems  (different  coating  manufactur¬ 
ers)  as  examined  in  this  project.  These  data,  however,  would  only  include  the  maxi¬ 
mum  undercutting  at  each  scribe. 

Panels  from  the  APEC  and  ACTS  programs  are  still  on  exposure  at  the  coke  works 
test  site  and  at  the  25-m  lot  at  Kure  Beach,  NC.  Some  panels  with  10  years  expo¬ 
sure  at  Kure  Beach  and  6  years  on  the  Mellon  Institute  roof  are  in  storage  at  SSPC 
and  could  be  evaluated  using  Method  1  or  Method  2.  These  panels  include  six  differ¬ 
ent  aluminum  filled  epoxy  systems  exposed  outdoors  as  well  as  in  the  cyclic  salt  fog 
cabinet.  Some  of  these  data  are  from  CERL  Project  DACW88-90-M-1363. 
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Determine  Validity  of  Benchmarking  for  Other  Systems  and  Exposures 

This  project  examined  two-  and  three-coat  systems.  Benchmarks  will  need  to  he 
determined  for  single-coat  systems.  These  would  he  useful  in  the  development  of 
paint  specifications  as  opposed  to  coating  system  specifications. 

For  use  in  coating  performance  specifications,  it  will  he  useful  to  determine  scrihe- 
undercutting  benchmarks  for  atmospheric  exposure  tests. 
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APPENDIX  A:  Raw  Data,  Method  1 

Appendix  A  contains  the  raw  data  for  Method  1  where  scribe  undercutting  was  measured  at  five  millimeter 
intervals  along  the  scribe.  The  IDs  in  the  Panel/Scribe  column  can  be  interpreted  as  follows: 

2A-7  means  System  2,  Panel  A,  the  7th  step  of  5  mm,  i.e.,  30  mm  from  the  top  of  the  scribe. 

Since  there  are  two  scribes  per  panel,  2A-1  to  2A-12  are  measurements  made  on  the  top  scribe  while  2A-13  to  2A-24 
are  measurements  made  on  the  bottom  scribe.  Thus, 

4C-15  means  System  4,  Panel  C,  the  3rd  step  (15  -  12)  of  5  mm,  i.e.,  10  mm  from  the  top  of  the  lower  scribe. 

A  further  example: 

5F-1  means  System  5,  Panel  F,  top  of  the  upper  scribe 

5F-2  means  System  5,  Panel  F,  5  mm  from  the  top  measurement  of  the  upper  scribe 
5F-3  means  System  5,  Panel  F,  10  mm  from  the  top  measurement  of  the  upper  scribe 

5F-12  means  System  5,  Panel  F,  55  mm  from  the  top  measurement  of  the  upper  scribe  (the  last  measurement  taken 
on  the  upper  scribe).  The  template  was  centered  so  that  no  measurements  were  taken  at  the  very  ends  of  the  scribe. 

5F-13  means  System  5,  Panel  F,  top  measurement  of  the  lower  scribe 

5F-14  means  System  5,  Panel  F,  5  mm  from  the  top  measurement  of  the  lower  scribe 

5F-15  means  System  5,  Panel  F,  10  mm  from  the  top  measurement  of  the  lower  scribe 

5F-24  means  System  5,  Panel  F,  55  mm  from  the  top  measurement  of  the  lower  scribe  (the  last  measurement  taken 
on  the  lower  scribe). 

Some  of  the  scribes  for  Systems  7,  8,  and  9  were  not  long  enough  for  12  measurements  5  mm  apart. 
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System  1  -  1680  Hours 


PANEL/SCRIBE 

LEFT 

RIGHT 

PANEL/SCRIBE 

LEFT 

RIGHT 

PANEL/SCRIBE 

LEFT 

RIGHT 

lA-1 

3 

3 

lC-1 

1 

1 

lE-1 

2 

5 

lA-2 

3 

2 

lC-2 

4 

6 

lE-2 

7 

8 

lA-3 

2 

2 

lC-3 

6 

5 

lE-3 

6 

7 

lA-4 

3 

2 

lC-4 

6 

3 

lE-4 

6 

4 

lA-5 

4 

5 

lC-5 

11 

12 

lE-5 

6 

6 

lA-6 

5 

7 

lC-6 

10 

15 

lE-6 

4 

3 

lA-7 

4 

7 

lC-7 

6 

13 

lE-7 

7 

3 

lA-8 

1 

3 

lC-8 

11 

4 

lE-8 

8 

2 

lA-9 

2 

3 

lC-9 

8 

8 

lE-9 

4 

4 

lA-10 

2 

9 

lC-10 

3 

3 

lE-10 

3 

5 

lA-11 

2 

9 

lC-11 

6 

6 

lE-11 

4 

3 

lA-12 

7 

2 

lC-12 

6 

4 

lE-12 

4 

4 

lA-13 

3 

5 

lC-13 

4 

6 

lE-13 

6 

3 

lA-14 

1 

5 

lC-14 

4 

6 

lE-14 

6 

4 

lA-15 

10 

6 

lC-15 

4 

5 

lE-15 

4 

4 

lA-16 

7 

7 

lC-16 

3 

4 

lE-16 

1 

6 

lA-17 

3 

4 

lC-17 

4 

4 

lE-17 

2 

6 

lA-18 

2 

3 

lC-18 

4 

5 

lE-18 

3 

5 

lA-19 

2 

4 

lC-19 

5 

5 

lE-19 

2 

3 

lA-2  0 

2 

5 

lC-20 

4 

5 

lE-20 

3 

3 

lA-21 

2 

8 

lC-21 

5 

6 

lE-21 

5 

3 

lA-22 

2 

2 

lC-22 

5 

6 

lE-22 

5 

4 

lA-23 

1 

4 

lC-23 

11 

2 

lE-23 

3 

5 

lA-24 

5 

3 

lC-24 

10 

7 

lE-24 

5 

6 

lB-1 

1 

2 

lD-1 

3 

2 

lF-1 

4 

4 

lB-2 

4 

3 

lD-2 

4 

2 

lF-2 

5 

5 

lB-3 

6 

4 

lD-3 

2 

3 

lF-3 

7 

5 

lB-4 

2 

2 

lD-4 

2 

2 

lF-4 

7 

4 

lB-5 

3 

1 

lD-5 

2 

3 

lF-5 

5 

6 

lB-6 

3 

4 

lD-6 

1 

2 

lF-6 

5 

6 

lB-7 

4 

3 

lD-7 

2 

2 

lF-7 

3 

4 

lB-8 

3 

4 

lD-8 

2 

1 

lF-8 

3 

7 

lB-9 

6 

5 

lD-9 

1 

2 

lF-9 

6 

5 

lB-10 

1 

5 

lD-10 

4 

5 

lF-10 

6 

5 

lB-11 

5 

4 

lD-11 

4 

4 

lF-11 

3 

3 

lB-12 

6 

3 

lD-12 

3 

3 

lF-12 

3 

3 

lB-13 

5 

6 

lD-13 

6 

4 

lF-13 

10 

6 

lB-14 

2 

2 

lD-14 

1 

4 

lF-14 

12 

6 

lB-15 

5 

4 

lD-15 

8 

10 

lF-15 

5 

4 

lB-16 

7 

10 

lD-16 

6 

11 

lF-16 

7 

3 

lB-17 

8 

4 

lD-17 

3 

8 

lF-17 

7 

9 

lB-18 

8 

8 

lD-18 

5 

7 

lF-18 

1 

11 

lB-19 

1 

1 

lD-19 

5 

2 

lF-19 

2 

11 

lB-20 

6 

7 

lD-20 

6 

5 

lF-20 

1 

7 

lB-21 

5 

2 

lD-21 

5 

6 

lF-21 

2 

3 

lB-22 

5 

7 

lD-22 

3 

5 

lF-22 

5 

8 

lB-23 

5 

5 

lD-23 

5 

5 

lF-23 

6 

10 

lB-24 

5 

6 

lD-24 

4 

4 

lF-24 

5 

3 
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System  1  -  2688  Hours 


PANEL/SCRIBE 

LEFT 

RIGHT 

PANEL/SCRIBE 

LEFT 

RIGHT 

PANEL/SCRIBE 

LEFT 

RIGHT 

lG-1 

10 

9 

ll-l 

10 

4 

lK-1 

6 

3 

lG-2 

10 

5 

11-2 

10 

1 

lK-2 

3 

2 

lG-3 

2 

3 

11-3 

3 

2 

lK-3 

3 

4 

lG-4 

6 

7 

11-4 

8 

5 

lK-4 

1 

5 

lG-5 

3 

8 

11-5 

8 

14 

lK-5 

4 

6 

lG-6 

4 

6 

11-6 

14 

14 

lK-6 

4 

2 

lG-7 

5 

4 

11-7 

10 

10 

lK-7 

6 

1 

lG-8 

2 

2 

11-8 

7 

3 

lK-8 

1 

3 

lG-9 

5 

2 

11-9 

10 

3 

lK-9 

4 

5 

lG-10 

5 

2 

11-10 

12 

2 

lK-10 

3 

5 

lG-11 

5 

4 

11-11 

12 

3 

lK-11 

1 

5 

lG-12 

4 

3 

11-12 

5 

5 

lK-12 

9 

2 

lG-13 

2 

5 

11-13 

4 

4 

lK-13 

6 

3 

lG-14 

2 

2 

11-14 

4 

4 

lK-14 

2 

6 

lG-15 

6 

9 

11-15 

5 

8 

lK-15 

1 

4 

lG-16 

6 

9 

11-16 

5 

12 

lK-16 

6 

6 

lG-17 

7 

7 

11-17 

4 

9 

lK-17 

1 

2 

lG-18 

9 

6 

11-18 

2 

4 

lK-18 

1 

1 

lG-19 

6 

7 

11-19 

9 

3 

lK-19 

2 

2 

lG-20 

7 

3 

11-20 

9 

3 

lK-20 

2 

3 

lG-21 

7 

5 

11-21 

6 

3 

lK-21 

1 

4 

lG-22 

8 

6 

11-22 

6 

7 

lK-22 

2 

4 

lG-23 

6 

2 

11-23 

6 

8 

lK-23 

5 

5 

lG-24 

3 

2 

11-24 

3 

3 

lK-24 

5 

2 

lH-1 

8 

5 

lJ-1 

4 

6 

lL-1 

6 

3 

lH-2 

9 

6 

lJ-2 

2 

5 

lL-2 

0.5 

6 

lH-3 

2 

8 

lJ-3 

6 

4 

lL-3 

5 

9 

lH-4 

2 

5 

lJ-4 

6 

6 

lL-4 

0.5 

7 

lH-5 

2 

2 

lJ-5 

5 

6 

lL-5 

9 

8 

lH-6 

2 

2 

lJ-6 

1 

5 

lL-6 

7 

7 

lH-7 

7 

1 

lJ-7 

2 

4 

lL-7 

5 

7 

lH-8 

9 

4 

lJ-8 

8 

6 

lL-8 

9 

12 

lH-9 

2 

7 

lJ-9 

5 

6 

lL-9 

6 

8 

lH-10 

2 

10 

lJ-10 

3 

4 

lL-10 

9 

12 

lH-11 

3 

10 

lJ-11 

5 

5 

lL-11 

11 

9 

lH-12 

4 

6 

lJ-12 

6 

4 

lL-12 

7 

9 

lH-13 

9 

2 

lJ-13 

7 

2 

lL-13 

10 

4 

lH-14 

9 

8 

lJ-14 

6 

8 

lL-14 

8 

7 

lH-15 

8 

2 

lJ-15 

1 

8 

lL-15 

8 

8 

lH-16 

5 

4 

lJ-16 

6 

4 

lL-16 

8 

10 

lH-17 

4 

2 

lJ-17 

0.5 

1 

lL-17 

8 

6 

lH-18 

4 

7 

lJ-18 

6 

0.5 

lL-18 

3 

3 

lH-19 

5 

6 

lJ-19 

5 

2 

lL-19 

1 

3 

lH-20 

1 

9 

lJ-20 

6 

6 

lL-20 

3 

2 

lH-21 

2 

8 

lJ-21 

4 

5 

lL-21 

2 

7 

lH-22 

7 

4 

lJ-22 

2 

1 

lL-22 

3 

7 

lH-23 

6 

8 

lJ-23 

1 

7 

lL-23 

0.5 

3 

lH-24 

6 

9 

lJ-24 

2 

9 

lL-24 

1 

1 
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System  1  -  3360  Hours 


PANEL/SCRIBE 

LEFT 

RIGHT 

PANEL/SCRIBE 

LEFT 

RIGHT 

PANEL/SCRIBE 

LEFT 

RIGHT 

lM-1 

9 

7 

10-1 

2 

2 

lQ-1 

8 

0.5 

lM-2 

8 

3 

10-2 

5 

5 

lQ-2 

6 

12 

lM-3 

3 

2 

10-3 

5 

5 

lQ-3 

4 

11 

lM-4 

6 

4 

10-4 

6 

9 

lQ-4 

11 

5 

lM-5 

3 

2 

10-5 

6 

9 

lQ-5 

11 

0.5 

lM-6 

5 

7 

10-6 

3 

8 

lQ-6 

3 

5 

lM-7 

9 

7 

10-7 

6 

5 

lQ-7 

7 

4 

lM-8 

6 

4 

10-8 

3 

3 

lQ-8 

4 

7 

lM-9 

5 

9 

10-9 

4 

4 

lQ-9 

4 

2 

lM-10 

7 

8 

10-10 

3 

4 

lQ-10 

4 

4 

lM-11 

7 

5 

10-11 

8 

3 

lQ-11 

2 

3 

lM-12 

3 

1 

10-12 

8 

3 

lQ-12 

4 

5 

lM-13 

10 

6 

10-13 

3 

4 

lQ-13 

5 

3 

lM-14 

8 

10 

10-14 

2 

3 

lQ-14 

4 

4 

lM-15 

5 

9 

10-15 

1 

10 

lQ-15 

3 

3 

lM-16 

5 

1 

10-16 

0.5 

12 

lQ-16 

3 

4 

lM-17 

8 

1 

10-17 

3 

5 

lQ-17 

5 

4 

lM-18 

7 

7 

10-18 

2 

3 

lQ-18 

6 

4 

lM-19 

5 

8 

10-19 

5 

4 

lQ-19 

4 

5 

lM-2  0 

5 

5 

10-20 

10 

4 

lQ-20 

4 

6 

lM-21 

6 

3 

10-21 

12 

7 

lQ-21 

6 

5 

lM-22 

6 

6 

10-22 

11 

5 

lQ-22 

7 

6 

lM-23 

6 

4 

10-23 

4 

6 

lQ-23 

5 

6 

lM-24 

5 

3 

10-24 

4 

7 

lQ-24 

3 

4 

lN-1 

8 

5 

lP-1 

4 

7 

lR-1 

7 

7 

lN-2 

9 

0.5 

lP-2 

4 

9 

lR-2 

4 

7 

lN-3 

5 

2 

lP-3 

6 

8 

lR-3 

4 

4 

lN-4 

7 

2 

lP-4 

5 

7 

lR-4 

5 

4 

lN-5 

6 

6 

lP-5 

6 

6 

lR-5 

8 

5 

lN-6 

5 

3 

lP-6 

4 

7 

lR-6 

7 

5 

lN-7 

1 

2 

lP-7 

6 

5 

lR-7 

8 

5 

lN-8 

7 

1 

lP-8 

3 

5 

lR-8 

7 

3 

lN-9 

7 

4 

lP-9 

4 

6 

lR-9 

1 

7 

lN-10 

1 

0.5 

lP-10 

5 

5 

lR-10 

6 

3 

lN-11 

5 

5 

lP-11 

5 

5 

lR-11 

1 

4 

lN-12 

6 

4 

lP-12 

7 

4 

lR-12 

10 

5 

lN-13 

3 

5 

lP-13 

3 

8 

lR-13 

5 

5 

lN-14 

4 

6 

lP-14 

5 

3 

lR-14 

4 

5 

lN-15 

8 

5 

lP-15 

2 

10 

lR-15 

7 

5 

lN-16 

5 

3 

lP-16 

5 

5 

lR-16 

5 

6 

lN-17 

1 

5 

lP-17 

3 

5 

lR-17 

8 

4 

lN-18 

6 

3 

lP-18 

4 

6 

lR-18 

6 

7 

lN-19 

1 

3 

lP-19 

4 

4 

lR-19 

4 

6 

lN-20 

1 

3 

lP-20 

3 

2 

lR-20 

2 

3 

lN-21 

1 

3 

lP-21 

7 

4 

lR-21 

5 

5 

lN-22 

6 

6 

lP-22 

7 

5 

lR-22 

6 

6 

lN-23 

2 

5 

lP-23 

7 

4 

lR-23 

3 

4 

lN-24 

1 

1 

lP-24 

6 

4 

lR-24 

2 

5 

A-4 


ERDC/CERL  TR-01-74 
November  2001 


System  2  -  3360  Hours 


PANEL/SCRIBE 

LEFT 

RIGHT 

PANEL/SCRIBE 

LEFT 

RIGHT 

PANEL/SCRIBE 

LEFT 

RIGHT 

2A-1 

2 

5 

2C-1 

3 

3 

2E-1 

3 

5 

2A-2 

1 

6 

2C-2 

4 

5 

2E-2 

5 

4 

2A-3 

5 

5 

2C-3 

2 

7 

2E-3 

8 

4 

2A-4 

4 

7 

2C-4 

4 

6 

2E-4 

10 

4 

2A-5 

3 

6 

2C-5 

6 

7 

2E-5 

7 

6 

2  A- 6 

2 

5 

2C-6 

7 

3 

2E-6 

5 

7 

2A-7 

4 

4 

2C-7 

5 

5 

2E-7 

4 

6 

2  A- 8 

3 

5 

2C-8 

6 

5 

2E-8 

6 

3 

2  A- 9 

4 

4 

2C-9 

3 

7 

2E-9 

4 

5 

2  A- 10 

3 

3 

2C-10 

5 

5 

2E-10 

3 

6 

2  A- 11 

3 

3 

2C-11 

6 

4 

2E-11 

3 

6 

2A-12 

3 

4 

2C-12 

5 

4 

2E-12 

2 

5 

2A-13 

7 

5 

2C-13 

7 

10 

2E-13 

1 

3 

2A-14 

7 

5 

2C-14 

7 

5 

2E-14 

1 

5 

2A-15 

5 

5 

2C-15 

5 

7 

2E-15 

4 

6 

2  A- 16 

5 

7 

2C-16 

8 

7 

2E-16 

4 

6 

2A-17 

6 

4 

2C-17 

7 

9 

2E-17 

3 

3 

2A-18 

4 

1 

2C-18 

5 

8 

2E-18 

4 

7 

2  A- 19 

6 

8 

2C-19 

8 

8 

2E-19 

4 

7 

2A-2  0 

2 

5 

2C-20 

7 

5 

2E-20 

5 

6 

2A-21 

1 

4 

2C-21 

5 

6 

2E-21 

3 

6 

2A-22 

6 

6 

2C-22 

4 

8 

2E-22 

5 

6 

2A-23 

1 

1 

2C-23 

4 

7 

2E-23 

5 

3 

2A-24 

2 

4 

2C-24 

4 

5 

2E-24 

5 

6 

2B-1 

5 

6 

2D-1 

6 

4 

2F-1 

6 

5 

2B-2 

7 

5 

2D-2 

3 

6 

2F-2 

8 

9 

2B-3 

5 

7 

2D-3 

5 

6 

2F-3 

8 

4 

2B-4 

5 

6 

2D-4 

7 

7 

2F-4 

7 

5 

2B-5 

4 

8 

2D-5 

6 

7 

2F-5 

5 

6 

2B-6 

5 

7 

2D-6 

6 

8 

2F-6 

8 

6 

2B-7 

5 

2 

2D-7 

4 

7 

2F-7 

6 

4 

2B-8 

5 

6 

2D-8 

6 

5 

2F-8 

8 

6 

2B-9 

1 

6 

2D-9 

6 

6 

2F-9 

5 

7 

2B-10 

5 

5 

2D-10 

7 

6 

2F-10 

7 

6 

2B-11 

11 

5 

2D-11 

5 

5 

2F-11 

7 

9 

2B-12 

4 

4 

2D-12 

7 

3 

2F-12 

10 

8 

2B-13 

7 

8 

2D-13 

5 

6 

2F-13 

6 

3 

2B-14 

8 

5 

2D-14 

6 

5 

2F-14 

7 

7 

2B-15 

8 

5 

2D-15 

5 

5 

2F-15 

9 

8 

2B-16 

8 

5 

2D-16 

6 

5 

2F-16 

8 

9 

2B-17 

5 

6 

2D-17 

8 

7 

2F-17 

10 

6 

2B-18 

4 

5 

2D-18 

9 

4 

2F-18 

7 

8 

2B-19 

11 

8 

2D-19 

11 

8 

2F-19 

8 

7 

2B-20 

7 

4 

2D-20 

7 

8 

2F-20 

9 

7 

2B-21 

6 

7 

2D-21 

6 

7 

2F-21 

8 

9 

2B-22 

7 

7 

2D-22 

7 

7 

2F-22 

6 

8 

2B-23 

7 

7 

2D-23 

8 

9 

2F-23 

6 

5 

2B-24 

5 

5 

2D-24 

5 

7 

2F-24 

6 

7 

A-5 


ERDC/CERL  TR-01-74 
November  2001 


System  3  -  3360  Hours 


PANEL/SCRIBE 

LEFT 

RIGHT 

PANEL/SCRIBE 

LEFT 

RIGHT 

PANEL/SCRIBE 

LEFT 

RIGHT 

3A-1 

7 

8 

3C-1 

6 

4 

3E-1 

10 

10 

3A-2 

10 

10 

3C-2 

5 

5 

3E-2 

10 

7 

3  A- 3 

10 

9 

3C-3 

6 

5 

3E-3 

7 

4 

3  A- 4 

10 

9 

3C-4 

5 

7 

3E-4 

15 

2 

3  A- 5 

10 

6 

3C-5 

2 

9 

3E-5 

6 

7 

3  A- 6 

8 

8 

3C-6 

7 

10 

3E-6 

7 

5 

3  A- 7 

7 

4 

3C-7 

3 

8 

3E-7 

9 

9 

3  A- 8 

7 

6 

3C-8 

5 

9 

3E-8 

5 

9 

3  A- 9 

6 

7 

3C-9 

4 

9 

3E-9 

4 

9 

3  A- 10 

6 

8 

3C-10 

5 

7 

3E-10 

9 

7 

3  A- 11 

10 

11 

3C-11 

8 

5 

3E-11 

13 

6 

3A-12 

11 

13 

3C-12 

6 

9 

3E-12 

12 

5 

3A-13 

11 

8 

3C-13 

11 

7 

3E-13 

7 

5 

3A-14 

4 

2 

3C-14 

7 

5 

3E-14 

7 

8 

3A-15 

2 

6 

3C-15 

8 

7 

3E-15 

5 

8 

3A-16 

7 

3 

3C-16 

9 

11 

3E-16 

7 

11 

3A-17 

14 

4 

3C-17 

8 

9 

3E-17 

5 

11 

3A-18 

14 

8 

3C-18 

8 

8 

3E-18 

9 

8 

3A-19 

10 

7 

3C-19 

9 

6 

3E-19 

9 

8 

3A-2  0 

11 

3 

3C-20 

9 

8 

3E-20 

8 

5 

3A-21 

3 

10 

3C-21 

10 

6 

3E-21 

9 

6 

3A-22 

5 

6 

3C-22 

13 

8 

3E-22 

11 

5 

3A-2  3 

10 

11 

3C-23 

12 

8 

3E-23 

12 

7 

3A-2  4 

8 

12 

3C-24 

7 

5 

3E-24 

7 

9 

3B-1 

4 

10 

3D-1 

4 

7 

3F-1 

5 

4 

3B-2 

6 

4 

3D-2 

6 

7 

3F-2 

4 

4 

3B-3 

6 

3 

3D-3 

5 

6 

3F-3 

7 

6 

3B-4 

2 

4 

3D-4 

3 

5 

3F-4 

5 

13 

3B-5 

4 

4 

3D-5 

6 

6 

3F-5 

6 

14 

3B-6 

5 

3 

3D-6 

10 

5 

3F-6 

14 

12 

3B-7 

5 

2 

3D-7 

10 

4 

3F-7 

12 

7 

3B-8 

5 

3 

3D-8 

6 

4 

3F-8 

14 

9 

3B-9 

5 

5 

3D-9 

6 

11 

3F-9 

10 

6 

3B-10 

6 

5 

3D-10 

8 

13 

3F-10 

12 

6 

3B-11 

5 

5 

3D-11 

11 

12 

3F-11 

5 

7 

3B-12 

5 

4 

3D-12 

7 

5 

3F-12 

10 

2 

3B-13 

5 

8 

3D-13 

5 

3 

3F-13 

3 

7 

3B-14 

4 

4 

3D-14 

8 

6 

3F-14 

7 

7 

3B-15 

5 

1 

3D-15 

5 

7 

3F-15 

12 

5 

3B-16 

8 

1 

3D-16 

8 

9 

3F-16 

5 

8 

3B-17 

8 

1 

3D-17 

6 

9 

3F-17 

9 

8 

3B-18 

3 

6 

3D-18 

6 

12 

3F-18 

9 

8 

3B-19 

1 

7 

3D-19 

13 

9 

3F-19 

8 

7 

3B-20 

2 

6 

3D-20 

11 

9 

3F-20 

12 

4 

3B-21 

3 

5 

3D-21 

9 

7 

3F-21 

9 

5 

3B-22 

6 

8 

3D-22 

7 

7 

3F-22 

5 

4 

3B-23 

9 

5 

3D-23 

8 

5 

3F-23 

8 

7 

3B-24 

8 

3 

3D-24 

8 

9 

3F-24 

5 

7 

A-6 


ERDC/CERL  TR-01-74 
November  2001 


System  4  -  3360  Hours 


PANEL/SCRIBE 

LEFT 

RIGHT 

PANEL/SCRIBE 

LEFT 

RIGHT 

PANEL/SCRIBE 

LEFT 

RIGHT 

4A-1 

4 

4 

4C-1 

5 

2 

4E-1 

3 

6 

4A-2 

6 

5 

4C-2 

3 

1 

4E-2 

2 

4 

4A-3 

5 

7 

4C-3 

2 

2 

4E-3 

4 

6 

4A-4 

5 

6 

4C-4 

2 

1 

4E-4 

3 

4 

4A-5 

4 

4 

4C-5 

3 

1 

4E-5 

2 

3 

4  A- 6 

5 

4 

4C-6 

3 

2 

4E-6 

2 

3 

4A-7 

4 

5 

4C-7 

1 

1 

4E-7 

1 

3 

4  A- 8 

5 

5 

4C-8 

3 

2 

4E-8 

4 

6 

4  A- 9 

8 

2 

4C-9 

1 

2 

4E-9 

3 

7 

4  A- 10 

3 

3 

4C-10 

1 

1 

4E-10 

3 

5 

4  A- 11 

4 

5 

4C-11 

1 

2 

4E-11 

2 

5 

4A-12 

3 

4 

4C-12 

3 

2 

4E-12 

3 

3 

4A-13 

3 

4 

4C-13 

2 

5 

4E-13 

3 

3 

4A-14 

5 

4 

4C-14 

2 

4 

4E-14 

2 

4 

4A-15 

4 

3 

4C-15 

4 

3 

4E-15 

2 

2 

4  A- 16 

5 

7 

4C-16 

7 

3 

4E-16 

4 

3 

4A-17 

4 

4 

4C-17 

2 

5 

4E-17 

3 

3 

4A-18 

4 

3 

4C-18 

3 

4 

4E-18 

2 

4 

4  A- 19 

5 

2 

4C-19 

3 

4 

4E-19 

3 

2 

4A-2  0 

5 

3 

4C-20 

1 

3 

4E-20 

4 

2 

4A-21 

2 

5 

4C-21 

1 

3 

4E-21 

3 

5 

4A-22 

4 

2 

4C-22 

4 

5 

4E-22 

3 

2 

4A-23 

4 

4 

4C-23 

2 

2 

4E-23 

4 

4 

4A-24 

4 

6 

4C-24 

4 

2 

4E-24 

4 

6 

4B-1 

4 

3 

4D-1 

3 

2 

4F-1 

2 

2 

4B-2 

6 

4 

4D-2 

1 

3 

4F-2 

4 

2 

4B-3 

3 

6 

4D-3 

3 

2 

4F-3 

3 

5 

4B-4 

4 

6 

4D-4 

3 

3 

4F-4 

1 

5 

4B-5 

4 

5 

4D-5 

3 

2 

4F-5 

1 

4 

4B-6 

3 

4 

4D-6 

4 

5 

4F-6 

4 

4 

4B-7 

4 

5 

4D-7 

2 

5 

4F-7 

4 

2 

4B-8 

3 

5 

4D-8 

3 

5 

4F-8 

4 

2 

4B-9 

8 

9 

4D-9 

2 

9 

4F-9 

4 

5 

4B-10 

6 

6 

4D-10 

2 

6 

4F-10 

3 

5 

4B-11 

5 

4 

4D-11 

4 

3 

4F-11 

2 

3 

4B-12 

5 

3 

4D-12 

2 

6 

4F-12 

2 

2 

4B-13 

3 

2 

4D-13 

10 

5 

4F-13 

4 

3 

4B-14 

4 

3 

4D-14 

4 

8 

4F-14 

2 

3 

4B-15 

4 

4 

4D-15 

3 

3 

4F-15 

3 

3 

4B-16 

6 

9 

4D-16 

5 

3 

4F-16 

3 

5 

4B-17 

6 

5 

4D-17 

3 

6 

4F-17 

4 

4 

4B-18 

5 

4 

4D-18 

3 

7 

4F-18 

4 

3 

4B-19 

5 

6 

4D-19 

1 

6 

4F-19 

4 

7 

4B-20 

5 

4 

4D-20 

2 

4 

4F-20 

3 

4 

4B-21 

4 

5 

4D-21 

2 

3 

4F-21 

3 

4 

4B-22 

8 

6 

4D-22 

3 

2 

4F-22 

3 

2 

4B-23 

3 

5 

4D-23 

3 

3 

4F-23 

3 

3 

4B-24 

3 

4 

4D-24 

2 

4 

4F-24 

6 

4 

A-7 


ERDC/CERL  TR-01-74 
November  2001 


System  5  -  3360  Hours 


PANEL/SCRIBE 

LEFT 

RIGHT 

PANEL/SCRIBE 

LEFT 

RIGHT 

PANEL/SCRIBE 

LEFT 

RIGHT 

5A-1 

0.5 

0.5 

5C-1 

2 

1 

5E-1 

0.5 

0.5 

5A-2 

1 

1 

5C-2 

2 

2 

5E-2 

0.5 

1 

5  A- 3 

1 

2 

5C-3 

2 

4 

5E-3 

2 

2 

5  A- 4 

0.5 

0.5 

5C-4 

3 

2 

5E-4 

1 

1 

5  A- 5 

0.5 

0.5 

5C-5 

2 

2 

5E-5 

2 

0.5 

5  A- 6 

1 

0.5 

5C-6 

2 

5 

5E-6 

2 

1 

5  A- 7 

0.5 

0.5 

5C-7 

3 

4 

5E-7 

1 

0.5 

5  A- 8 

0.5 

0.5 

5C-8 

2 

6 

5E-8 

1 

1 

5  A- 9 

0.5 

0.5 

5C-9 

3 

5 

5E-9 

2 

1 

5  A- 10 

0.5 

1 

5C-10 

5 

4 

5E-10 

2 

1 

5  A- 11 

0.5 

2 

5C-11 

3 

5 

5E-11 

1 

2 

5A-12 

1 

2 

5C-12 

5 

5 

5E-12 

1 

2 

5A-13 

1 

2 

5C-13 

5 

3 

5E-13 

2 

1 

5A-14 

0.5 

3 

5C-14 

3 

3 

5E-14 

2 

2 

5A-15 

2 

2 

5C-15 

3 

3 

5E-15 

1 

2 

5A-16 

1 

2 

5C-16 

3 

3 

5E-16 

1 

2 

5A-17 

0.5 

2 

5C-17 

3 

3 

5E-17 

1 

3 

5A-18 

2 

1 

5C-18 

2 

4 

5E-18 

1 

3 

5A-19 

1 

0.5 

5C-19 

3 

3 

5E-19 

2 

3 

5A-2  0 

0.5 

0.5 

5C-20 

2 

2 

5E-20 

2 

1 

5A-21 

0.5 

0.5 

5C-21 

1 

2 

5E-21 

2 

1 

5A-22 

2 

3 

5C-22 

1 

2 

5E-22 

3 

2 

5A-2  3 

1 

1 

5C-23 

1 

1 

5E-23 

3 

5 

5A-2  4 

1 

1 

5C-24 

2 

2 

5E-24 

3 

2 

5B-1 

0.5 

3 

5D-1 

4 

3 

5F-1 

3 

2 

5B-2 

3 

0.5 

5D-2 

3 

3 

5F-2 

1 

1 

5B-3 

0.5 

0.5 

5D-3 

3 

3 

5F-3 

3 

3 

5B-4 

0.5 

0.5 

5D-4 

3 

3 

5F-4 

2 

2 

5B-5 

2 

0.5 

5D-5 

3 

3 

5F-5 

3 

1 

5B-6 

0.5 

0.5 

5D-6 

3 

3 

5F-6 

2 

2 

5B-7 

0.5 

2 

5D-7 

3 

3 

5F-7 

2 

1 

5B-8 

0.5 

0.5 

5D-8 

2 

3 

5F-8 

1 

3 

5B-9 

2 

1 

5D-9 

3 

3 

5F-9 

3 

3 

5B-10 

0.5 

0.5 

5D-10 

3 

2 

5F-10 

3 

2 

5B-11 

0.5 

0.5 

5D-11 

3 

3 

5F-11 

1 

2 

5B-12 

0.5 

2 

5D-12 

3 

3 

5F-12 

2 

4 

5B-13 

1 

2 

5D-13 

3 

3 

5F-13 

2 

2 

5B-14 

2 

2 

5D-14 

2 

3 

5F-14 

3 

1 

5B-15 

0.5 

0.5 

5D-15 

2 

3 

5F-15 

1 

4 

5B-16 

0.5 

1 

5D-16 

3 

2 

5F-16 

1 

1 

5B-17 

0.5 

3 

5D-17 

3 

4 

5F-17 

2 

1 

5B-18 

0.5 

2 

5D-18 

3 

3 

5F-18 

1 

1 

5B-19 

0.5 

1 

5D-19 

3 

3 

5F-19 

0.5 

1 

5B-20 

0.5 

2 

5D-20 

2 

2 

5F-20 

1 

1 

5B-21 

2 

1 

5D-21 

3 

3 

5F-21 

1 

2 

5B-22 

1 

2 

5D-22 

4 

4 

5F-22 

1 

2 

5B-23 

0.5 

2 

5D-23 

3 

3 

5F-23 

1 

2 

5B-24 

1 

1 

5D-24 

2 

3 

5F-24 

1 

1 

A-8 


ERDC/CERL  TR-01-74 
November  2001 


System  6  -  1680  Hours 


PANEL/SCRIBE 

LEFT 

RIGHT 

PANEL/SCRIBE 

LEFT 

RIGHT 

PANEL/SCRIBE 

LEFT 

RIGHT 

6A-1 

3 

2 

6C-1 

4 

5 

6E-1 

4 

4 

6  A- 2 

3 

3 

6C-2 

4 

5 

6E-2 

3 

3 

6  A- 3 

3 

3 

6C-3 

6 

7 

6E-3 

1 

3 

6  A- 4 

2 

3 

6C-4 

6 

6 

6E-4 

2 

4 

6  A- 5 

5 

5 

6C-5 

3 

5 

6E-5 

3 

2 

6A-6 

7 

8 

6C-6 

4 

4 

6E-6 

2 

4 

6  A- 7 

4 

5 

6C-7 

2 

6 

6E-7 

4 

4 

6  A- 8 

4 

5 

6C-8 

7 

4 

6E-8 

1 

3 

6A-  9 

3 

8 

6C-9 

7 

10 

6E-  9 

5 

4 

6  A- 10 

4 

5 

6C-10 

5 

7 

6E-10 

2 

3 

6  A- 11 

3 

5 

6C-11 

7 

6 

6E-11 

1 

1 

6A-12 

4 

5 

6C-12 

5 

4 

6E-12 

2 

2 

6A-13 

2 

2 

6C-13 

7 

6 

6E-13 

5 

5 

6A-14 

1 

4 

6C-14 

5 

5 

6E-14 

3 

4 

6A-15 

2 

2 

6C-15 

6 

5 

6E-15 

4 

5 

6A-16 

2 

3 

6C-16 

5 

5 

6E-16 

3 

4 

6A-17 

4 

3 

6C-17 

2 

5 

6E-17 

3 

4 

6A-18 

5 

4 

6C-18 

5 

8 

6E-18 

2 

3 

6A-19 

3 

4 

6C-19 

4 

5 

6E-19 

2 

6 

6  A- 2  0 

1 

2 

6C-20 

4 

4 

6E-20 

2 

4 

6  A- 21 

5 

4 

6C-21 

3 

3 

6E-21 

4 

4 

6A-22 

4 

3 

6C-22 

4 

6 

6E-22 

3 

3 

6  A- 2  3 

2 

4 

6C-23 

5 

5 

6E-23 

2 

2 

6  A- 2  4 

3 

5 

6C-24 

5 

3 

6E-24 

3 

4 

6B-1 

4 

6 

6D-1 

7 

5 

6F-1 

2 

3 

6B-2 

4 

5 

6D-2 

9 

10 

6F-2 

5 

3 

6B-3 

10 

8 

6D-3 

3 

11 

6F-3 

3 

2 

6B-4 

5 

8 

6D-4 

5 

6 

6F-4 

2 

3 

6B-5 

5 

7 

6D-5 

4 

5 

6F-5 

3 

3 

6B-6 

9 

6 

6D-6 

3 

7 

6F-6 

3 

3 

6B-7 

2 

7 

6D-7 

5 

5 

6F-7 

3 

4 

6B-8 

7 

7 

6D-8 

5 

5 

6F-8 

2 

3 

6B-  9 

6 

5 

6D-  9 

4 

3 

6F-  9 

2 

3 

6B-10 

4 

6 

6D-10 

5 

7 

6F-10 

4 

4 

6B-11 

4 

4 

6D-11 

7 

5 

6F-11 

4 

4 

6B-12 

3 

2 

6D-12 

7 

5 

6F-12 

4 

3 

6B-13 

3 

5 

6D-13 

6 

8 

6F-13 

4 

3 

6B-14 

4 

2 

6D-14 

6 

11 

6F-14 

3 

4 

6B-15 

5 

5 

6D-15 

4 

7 

6F-15 

3 

3 

6B-16 

4 

6 

6D-16 

5 

7 

6F-16 

2 

2 

6B-17 

5 

5 

6D-17 

4 

6 

6F-17 

2 

5 

6B-18 

4 

4 

6D-18 

5 

5 

6F-18 

5 

4 

6B-19 

4 

5 

6D-19 

4 

6 

6F-19 

3 

4 

6B-20 

3 

5 

6D-20 

6 

5 

6F-20 

4 

6 

6B-21 

5 

3 

6D-21 

5 

4 

6F-21 

5 

6 

6B-22 

7 

6 

6D-22 

3 

3 

6F-22 

5 

5 

6B-23 

2 

4 

6D-23 

5 

3 

6F-23 

5 

5 

6B-24 

4 

5 

6D-24 

5 

6 

6F-24 

5 

5 
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November  2001 


System  6  -  3360  Hours 


PANEL/SCRIBE 

LEFT 

RIGHT 

PANEL/SCRIBE 

LEFT 

RIGHT 

PANEL/SCRIBE 

LEFT 

RIGHT 

6G-1 

5 

4 

61-1 

3 

2 

6K-1 

2 

4 

6G-2 

8 

6 

61-2 

1 

7 

6K-2 

2 

3 

6G-3 

7 

6 

61-3 

2 

3 

6K-3 

4 

3 

6G-4 

7 

8 

61-4 

4 

3 

6K-4 

5 

3 

6G-5 

6 

9 

61-5 

2 

3 

6K-5 

4 

5 

6G-6 

6 

4 

61-6 

2 

3 

6K-  6 

4 

7 

6G-7 

7 

5 

61-7 

2 

2 

6K-7 

3 

3 

6G-8 

6 

5 

61-8 

2 

2 

6K-8 

3 

3 

6G-9 

7 

4 

61-9 

2 

2 

6K-9 

3 

4 

6G-10 

8 

7 

61-10 

3 

5 

6K-10 

13 

9 

6G-11 

8 

8 

61-11 

3 

3 

6K-11 

12 

11 

6G-12 

7 

5 

61-12 

7 

2 

6K-12 

11 

6 

6G-13 

4 

4 

61-13 

4 

4 

6K-13 

8 

5 

6G-14 

5 

4 

61-14 

2 

2 

6K-14 

3 

3 

6G-15 

4 

3 

61-15 

3 

2 

6K-15 

4 

2 

6G-16 

3 

6 

61-16 

3 

3 

6K-16 

7 

4 

6G-17 

3 

3 

61-17 

2 

3 

6K-17 

7 

5 

6G-18 

5 

6 

61-18 

4 

2 

6K-18 

7 

3 

6G-19 

7 

4 

61-19 

2 

6 

6K-19 

8 

6 

6G-2  0 

5 

4 

61-20 

2 

2 

6K-2  0 

5 

3 

6G-21 

4 

6 

61-21 

2 

3 

6K-21 

3 

2 

6G-22 

5 

9 

61-22 

2 

2 

6K-22 

4 

3 

6G-23 

5 

5 

61-23 

2 

2 

6K-23 

3 

4 

6G-24 

9 

7 

61-24 

3 

7 

6K-24 

4 

3 

6H-1 

4 

4 

6J-1 

3 

2 

6L-1 

4 

5 

6H-2 

3 

5 

6J-2 

5 

3 

6L-2 

8 

6 

6H-3 

4 

3 

6J-3 

4 

5 

6L-3 

8 

9 

6H-4 

3 

7 

6J-4 

4 

4 

6L-4 

7 

11 

6H-5 

4 

3 

6J-5 

5 

4 

6L-5 

6 

8 

6H-6 

2 

5 

6J-6 

2 

7 

6L-6 

11 

5 

6H-7 

2 

8 

6J-7 

3 

4 

6L-7 

5 

6 

6H-8 

3 

3 

6J-8 

4 

3 

6L-8 

9 

8 

6H-9 

5 

4 

6J-9 

3 

2 

6L-9 

7 

11 

6H-10 

5 

8 

6J-10 

2 

4 

6L-10 

8 

12 

6H-11 

4 

8 

6J-11 

2 

4 

6L-11 

11 

4 

6H-12 

3 

3 

6J-12 

3 

2 

6L-12 

7 

9 

6H-13 

4 

9 

6J-13 

5 

5 

6L-13 

4 

10 

6H-14 

6 

5 

6J-14 

1 

2 

6L-14 

6 

3 

6H-15 

4 

6 

6J-15 

1 

3 

6L-15 

6 

4 

6H-16 

4 

7 

6J-16 

2 

1 

6L-16 

4 

3 

6H-17 

7 

7 

6J-17 

3 

2 

6L-17 

4 

4 

6H-18 

6 

7 

6J-18 

4 

2 

6L-18 

4 

5 

6H-19 

5 

5 

6J-19 

3 

5 

6L-19 

8 

6 

6H-20 

5 

4 

6J-2  0 

3 

3 

6L-20 

10 

6 

6H-21 

5 

5 

6J-21 

4 

4 

6L-21 

9 

7 

6H-22 

5 

5 

6J-22 

3 

4 

6L-22 

8 

8 

6H-23 

6 

7 

6J-23 

3 

3 

6L-23 

4 

8 

6H-24 

8 

7 

6J-24 

3 

3 

6L-24 

14 

8 
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System  7  -  3360 

Hours 


PANEL/ 

SCRIBE 

LEET 

RIGHT 

PANEL/ 

SCRIBE 

LEET 

RIGHT 

PANEL 

/SCRI 

BE 

LEET 

RIGHT 

PANEL/ 

SCRIBE 

LEET 

RIGHT 

7A-1 

0.5 

0.5 

7C-I 

I 

I 

7E-I 

2 

I 

7G-I 

I 

I 

7A-2 

1 

I 

7C-2 

2 

I 

7E-2 

I 

I 

7G-2 

I 

I 

7A-3 

1 

I 

7C-3 

2 

I 

7E-3 

I 

2 

7G-3 

I 

2 

7A-4 

1 

I 

7C-4 

3 

I 

7E-4 

2 

3 

7G-4 

2 

2 

7A-5 

1 

I 

7C-5 

I 

I 

7E-5 

2 

2 

7G-5 

2 

2 

7  A- 6 

1 

I 

7C-6 

2 

I 

7E-6 

2 

2 

7G-6 

I 

2 

7A-7 

1 

2 

7C-7 

2 

I 

7E-7 

2 

I 

7G-7 

2 

2 

7A-8 

1 

I 

7C-8 

I 

I 

7E-8 

I 

2 

7G-8 

2 

2 

7  A- 9 

1 

I 

7C-9 

2 

I 

7E-9 

I 

2 

7G-9 

2 

2 

7A-10 

0.5 

0.5 

7C-I0 

I 

I 

7E-I0 

2 

I 

7G-I0 

2 

2 

7A-11 

0.5 

I 

7C-II 

2 

I 

7E-II 

I 

I 

7G-II 

I 

2 

7A-12 

1 

I 

7C-I2 

2 

I 

7E-I2 

I 

2 

7G-I2 

I 

I 

7A-13 

1 

I 

7C-I3 

I 

2 

7E-I3 

I 

I 

7G-I3 

I 

I 

7A-14 

1 

2 

7C-I4 

I 

I 

7E-I4 

I 

2 

7G-I4 

I 

I 

7A-15 

1 

I 

7C-I5 

I 

I 

7E-I5 

2 

I 

7G-I5 

I 

2 

7A-16 

1 

I 

7C-I6 

I 

I 

7E-I6 

I 

I 

7G-I6 

I 

2 

7A-17 

1 

2 

7C-I7 

I 

I 

7E-I7 

I 

I 

7G-I7 

I 

I 

7A-18 

1 

I 

7C-I8 

I 

I 

7E-I8 

I 

I 

7G-I8 

I 

I 

7A-19 

1 

I 

7C-I9 

I 

2 

7E-I9 

I 

4 

7G-I9 

I 

I 

7A-20 

1 

I 

7C-20 

I 

I 

7E-20 

2 

I 

7G-20 

I 

2 

7B-1 

2 

I 

7D-I 

I 

I 

7E-I 

3 

2 

7G-2I 

I 

2 

7B-2 

1 

I 

7D-2 

I 

2 

7E-2 

I 

I 

7G-22 

I 

4 

7B-3 

1 

I 

7D-3 

2 

2 

7E-3 

2 

I 

7G-23 

I 

2 

7B-4 

1 

I 

7D-4 

2 

2 

7E-4 

I 

2 

7G-24 

I 

I 

7B-5 

1 

I 

7D-5 

I 

I 

7E-5 

I 

2 

7B-6 

1 

I 

7D-6 

I 

I 

7E-6 

I 

2 

7B-7 

1 

2 

7D-7 

I 

2 

7E-7 

I 

2 

7B-8 

1 

I 

7D-8 

I 

2 

7E-8 

I 

2 

7B-9 

1 

I 

7D-9 

3 

I 

7E-9 

4 

4 

7B-10 

2 

2 

7D-I0 

I 

2 

7E-I0 

I 

2 

7B-11 

1 

I 

7D-II 

I 

2 

7E-II 

I 

3 

7B-12 

2 

2 

7D-I2 

I 

I 

7E-I2 

2 

I 

7B-13 

1 

I 

7D-I3 

I 

I 

7E-I3 

2 

I 

7B-14 

1 

I 

7D-I4 

3 

I 

7E-I4 

2 

I 

7B-15 

1 

I 

7D-I5 

I 

I 

7E-I5 

2 

I 

7B-16 

1 

I 

7D-I6 

I 

I 

7E-I6 

2 

I 

7B-17 

1 

2 

7D-I7 

I 

I 

7E-I7 

2 

2 

7B-18 

1 

I 

7D-I8 

2 

I 

7E-I8 

2 

I 

7B-19 

1 

I 

7D-I9 

2 

2 

7E-I9 

2 

2 

7D-20 

I 

2 

7E-20 

2 

I 

7D-2I 

I 

2 

7E-2I 

2 

2 

7D-22 

I 

2 

7E-22 

I 

2 
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System  8  -  3360  Hours 


8B-1  4  3  8D-1  2  4  8F-2  1  4 

8B-2  5  4  8D-2  1  2  8F-3  3  4 

8B-3  3  4  8D-3  1  3  8F-4  3  4 

8B-4  5  4  8D-4  1  5  8F-5  2  2 

8B-5  4  4  8D-5  4  3  8F-6  2  5 

8B-6  4  5  8D-6  3  1  8F-7  2  4 

8B-7  3  1  8D-7  4  1  8F-8  2  3 

8B-8  5  2  8D-8  3  3  8F-9  1  4 

8B-9  5  4  8D-9  3  2  8F-10  1  3 

8B-10  4  4  8D-10  4  2  8F-11  1  5 

8B-11  4  3  8D-11  1  1  8F-12  4  2 

8B-12  4  3  8D-12  5  1  8F-13  5  5 

8B-13  1  1  8D-13  1  2  8F-14  5  1 

8B-14  2  3  8D-14  2  2  8F-15  3  4 

8B-15  2  2  8D-15  3  4  8F-16  5  1 

8B-16  3  2  8D-16  3  2  8F-17  5  3 

8B-17  4  5  8D-17  3  1  8F-18  3  4 

8B-18  5  6  8D-18  4  2  8F-19  4  4 

8B-19  4  4  8D-19  4  3  8F-20  1  4 

8B-20  3  3  8D-20  2  3  8F-21  2  2 

8B-21  5  4  8D-21  3  4  8F-22  3  5 

8B-22  2  2  8D-22  3  3 

8B-23  3  2  8D-23  2  3 

8B-24  5  4  8D-24  2  2 
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System  9  -  3360  Hours 


9B-2  1  4  9D-1  4 _ 2  9F-1  2 _ 3 

9B-3  3  2  9D-2  1  3  9F-2  2  4 

9B-4  1  2  9D-3  2  3  9F-3  3  3 

9B-5  2  3  9D-4  2  4  9F-4  3  1 

9B-6  3  3  9D-5  3  3  9F-5  1  2 

9B-7  3  3  9D-6  2  2  9F-6  4  4 

9B-8  2  1  9D-7  2  1  9F-7  4  5 

9B-9  3  2  9D-8  3  3  9F-8  1  3 

9B-10  1  1  9D-9  4  3  9F-9  1  4 

9B-11  3  2  9D-10  1  2  9F-10  3  4 

9B-12  2  3  9D-11  1  3  9F-11  1  2 

9B-13  2  2  9D-12  2  4  9F-12  1  1 

9B-14  2  1  9D-13  1  2  9F-13  1  1 

9B-15  1  1  9D-14  1  2  9F-14  1  4 

9B-16  2  2  9D-15  3  3  9F-15  2  1 

9B-17  1  3  9D-16  3  4  9F-16  1  3 

9B-18  1  1  9D-17  3  3  9F-17  2  3 

9B-19  2  2  9D-18  2  3  9F-18  3  2 

9B-20  1  3  9D-19  1  2  9F-19  1  1 

9B-21  1  3  9D-20  3  2  9F-20  3  3 

9B-22  2  2  9D-21  2  1  9F-21  2  4 

9B-23  1  1  9D-22  2  2  9F-22  3  2 

9B-24  3  2  9D-23  3  2  9F-23  3  4 

9D-24  3  4  9F-24  1  2 
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System  2  -  3360  Hours  -  Remeasured  by  Observer  1 


PANEL/SCRIBE 

LEFT 

RIGHT 

PANEL/SCRIBE 

LEFT 

RIGHT 

PANEL/SCRIBE 

LEFT 

RIGHT 

2A-1 

3 

4 

2C-1 

3 

3 

2E-1 

3 

5 

2A-2 

4 

6 

2C-2 

3 

7 

2E-2 

6 

5 

2A-3 

6 

6 

2C-3 

6 

8 

2E-3 

9 

4 

2A-4 

3 

7 

2C-4 

6 

7 

2E-4 

9 

4 

2A-5 

3 

5 

2C-5 

6 

7 

2E-5 

6 

7 

2  A- 6 

3 

5 

2C-6 

6 

6 

2E-6 

6 

7 

2A-7 

4 

4 

2C-7 

4 

5 

2E-7 

6 

7 

2  A- 8 

3 

5 

2C-8 

4 

5 

2E-8 

6 

3 

2  A- 9 

4 

5 

2C-9 

6 

5 

2E-9 

4 

6 

2  A- 10 

2 

2 

2C-10 

4 

7 

2E-10 

3 

6 

2  A- 11 

4 

5 

2C-11 

6 

5 

2E-11 

4 

5 

2A-12 

5 

5 

2C-12 

5 

6 

2E-12 

2 

5 

2A-13 

8 

6 

2C-13 

5 

10 

2E-13 

2 

6 

2A-14 

8 

5 

2C-14 

7 

10 

2E-14 

3 

5 

2A-15 

6 

2 

2C-15 

4 

6 

2E-15 

3 

6 

2  A- 16 

6 

7 

2C-16 

8 

6 

2E-16 

4 

6 

2A-17 

6 

4 

2C-17 

7 

7 

2E-17 

5 

6 

2A-18 

5 

1 

2C-18 

6 

9 

2E-18 

5 

7 

2  A- 19 

6 

8 

2C-19 

4 

8 

2E-19 

4 

5 

2A-2  0 

7 

5 

2C-20 

6 

6 

2E-20 

6 

4 

2A-21 

5 

4 

2C-21 

6 

6 

2E-21 

5 

4 

2A-22 

7 

6 

2C-22 

3 

6 

2E-22 

4 

6 

2A-23 

3 

5 

2C-23 

4 

8 

2E-23 

4 

6 

2A-24 

3 

5 

2C-24 

4 

3 

2E-24 

5 

6 

2B-1 

7 

4 

2D-1 

6 

6 

2F-1 

7 

5 

2B-2 

7 

6 

2D-2 

5 

7 

2F-2 

8 

4 

2B-3 

4 

7 

2D-3 

6 

6 

2F-3 

8 

4 

2B-4 

5 

7 

2D-4 

5 

8 

2F-4 

7 

5 

2B-5 

5 

8 

2D-5 

6 
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Appendix  B:  Statistics  Tabies  and  Charts,  Method  1 

B1 .  Supplementary  Statistical  Tables  and  Charts  for  System  3 

Appendix  B  contains  tabies  and  charts  that  are  meant  to  suppiement  the  discussion  in  the  main 
body  of  the  report.  Figure  B1  compares  cumuiative  frequencies  with  a  normai  distribution.  Figure  B2  is 
simiiar  to  Figure  B1  except  that  the  cumuiative  frequencies  are  piotted  as  per  cent. 


Figure  Bl:  Histogram  vs.  Normal  of  System  3 

Cumulative  Frequencies 
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Figure  B2:  Simple  Count  Chart  of  System  3 

%  Cumulative  Frequencies  of  Scores 
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The  statistics  software  computes  descriptive  estimates  such  as  that  shown  in  Tabie  B1  for 
System  3.  Different  software  wiii  not  necessariiy  dispiay  the  statistics  in  the  same  format,  but  these 
computations  are  fairiy  standard.  Figure  B3,  the  percentiie  score  chart  for  System  3,  dispiays  a  few 
common  percentiies.  Referring  to  Tabie  B1 ,  there  is  a  90%  probabiiity  that  the  undercutting  at  a  random 
point  wiii  be  iess  than  or  equai  to  1 1  mm.  There  is  a  95%  probabiiity  that  it  wiii  be  iess  than  12  mm. 


Percentile 


System  3 
percentile 
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Table  B1 :  Descriptive  Estimates  for  System  3 


Sample  Size: 

288 

Minimum: 

1 

Maximum: 

15 

Sum: 

2045 

Range: 

14 

Sum  of  Squares: 

16829 

Semi-Inner  Qt. 

Range: 

2 

Mean: 

7.1007 

Median: 

7 

Lower  99%  C.I.: 

6.6703 

5th  Percentile: 

3 

Lower  95%  C.I.: 

6.7732 

10th  Percentile: 

4 

Upper  95%  C.I.: 

7.4282 

25th  Percentile: 

5 

Upper  99%  C.I.: 

7.5311 

75th  Percentile: 

9 

Adi.  Sum  Squares: 

2308.0799 

90th  Percentile: 

11 

Harmonic  Mean: 

5.6234 

95th  Percentile: 

12 

Variance: 

8.0421 

Standard  Error: 

0.1671 

Standard  Deviation: 

2.8359 

42.4925 

Coef.  of  Variation: 

0.3994 

Mean  Abs.  Dev: 

2.2696 

Skewness: 

0.3236 

Kurtosis: 

-0.21 

If  the  concern  is  the  probability  that  a  scribe  measurement  taken  at  random  will  be  less  than  a 
particular  value,  one  can  refer  to  Table  B2  that  gives  the  cumulative  frequency  distribution  of  System  3  or 
to  Figure  B4  which  is  a  plot  of  this  data.  For  example,  there  is  a  44.1%  probability  that  scribe  undercutting 
at  a  random  point  on  a  panel  coated  with  System  3  will  be  less  than  or  equal  to  6  mm.  There  is  a  87.5% 
probability  that  the  undercutting  will  be  less  than  or  equal  to  1 0  mm.  Thus,  for  a  particular  value  of  scribe 
undercutting,  the  corresponding  probability  can  be  determined. 
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Figure  B4:  Cumulative  Percent  Distribution  Polygon  of  System  3 
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Tabie  B2:  Cumuiative  Frequency  Distribution  of  System  3 


Scribe  Undercutting 
(mm) 

Frequency 

Cumulative 

Frequency 

Cumulative  % 

1 

4 

4 

1.39 

2 

8 

12 

4.17 

3 

13 

25 

8.68 

4 

23 

48 

16.67 

5 

46 

94 

32.64 

6 

33 

127 

44.10 

7 

40 

167 

57.99 

8 

36 

203 

70.49 

9 

30 

233 

80.90 

10 

19 

252 

87.50 

11 

13 

265 

92.01 

12 

11 

276 

95.83 

13 

6 

282 

97.92 

14 

5 

287 

99.65 

15 

1 

288 

100.00 

>16 

0 

288 

100.00 

B2.  Comparison  of  Statisticai  Caicuiations  from  Aii  Data  Sets 

Each  set  of  288  (or  more)  data  points  was  analyzed  using  a  statistics  software  computer 
application.  The  results  are  summarized  in  Table  B3  which  lists  selected  statistical  parameters  for  all  of 
the  data  sets.  Most  of  the  data  sets  conform  closely  to  a  normal  distribution.  Kurtosis  is  a  measure  of  how 
much  the  distribution  differs  from  normal.  An  ideal  normally  distributed  data  set  will  have  a  kurtosis  of 
zero.  Kurtosis  is  positive  if  there  is  excess  density  in  the  tails.  Figures  B5  to  B10  show  distributions  for  the 
data  sets  with  the  largest  kurtosis,  System  1  at  1680  hours  and  System  7  at  3360  hours.  Figures  B1 1  to 
B1 6  show  the  distributions  for  the  data  sets  with  kurtosis  closest  to  zero,  Systems  5  and  8  at  3360  hours. 
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Figure  B5:  Histogram  vs.  Normal  of  System  1  (1680  h) 
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Figure  B6:  Normal  Probability  Plot  of  System  1  (1680  h) 
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Figure  B7:  Histogram  vs.  Normal  of  System  1  (1680  h) 
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Figure  B8:  Histogram  vs.  Normal  of  System  7 
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Figure  B9:  Normal  Probability  Plot  of  System  7 
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Figure  BIO:  Histogram  vs.  Normal  of  System  7 
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Figure  Bll:  Histogram  vs.  Normal  of  System  5 
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Figure  B12:  Normal  Probability  Plot  of  System  5 


Expected  Normai  Quantiies 


B-9 


Frequencies  Frequencies 


Figure  B13:  Histogram  vs.  Normal  of  System  5 
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Figure  B14:  Histogram  vs.  Normal  of  System  8 
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Figure  B15:  Normal  Probability  Plot  of  System  8 
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Figure  B16:  Histogram  vs.  Normal  of  System  8 
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Appendix  C  -  Discussion  of  the  Weibull  Distribution  (Method  2W) 

C.l.  ‘BACKGROUND 

Weibull  analysis  is  a  common  technique  used  to  examine  the  durability  test  life  of  components. 
From  a  small  sample  of  actual  failure  and  suspended  test  data,  the  technique  can  estimate  the  expected 
failure  percentage  of  the  population.  In  this  application,  Weibull  analysis  is  used  to  estimate  the 
probability  that  a  given  level  of  undercutting  will  be  measured.  The  analysis  does  not  require  complicated 
measurements,  but  the  calculations  are  lengthy.  For  this  reason,  it  is  suggested  that  a  spreadsheet 
macro  be  used  in  the  analysis.  The  following  information  is  a  more  detailed  explanation  of  the  Weibull 
Distribution  analysis. 

C.2.  THE  WEIBULL  EQUATION 

The  Weibull  cumulative  distribution  function  is: 


F(x.  m,  p)  =  1-e  P 


Where 


^  is  the  value  at  which  to  evaluate  the  function 
m  is  a  parameter  0  <  m 

|3  is  a  parameter  0  <  P  <  1 


C.3.  REQUIRED  INFORMATION 

Maximum  undercutting  values  are  determined  for  each  of  the  twelve  scribes.  These  data  points 
are  used  to  create  the  parameters  m  and  13,  which  determine  the  shape  of  the  distribution  curve. 

Weibull  distribution  can  not  interpret  zero  values.  The  minimum  measurable  undercutting  distance 
(Xo^  is  assumed  to  be  0.5  mm  and  is  used  in  place  of  zero  values. 


c .  4 . 


DATA  MANIPULATION 


C.4.1  Rank  the  data  in  ascending  order,  i.e.,  the  smallest  undercutting  distance  will  be  given  a 
rank  of  1 .  Equal  distances  will  receive  the  same  rank. 

C.4.2  For  each  data  point  four  calculations  are  necessary,  as  follows: 

Rank-  0.5 


CDF  = 


number  of  data  points 


y  =  In  [In  (w)] 

X  =  In  (u),  where  u  is  a  measure  of  the  scribe  undercutting 


w= - 

1  -CDF 
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C.4.3  Calculate  the  slope,  m,  and  the  y-intercept,  b,  of  the  linear  regression  line  using  the  x  and 
y  values.  This  computation  is  most  easily  done  on  a  calculator  or  computer.  The  equation  of  the  linear 
regression  iine  will  be  in  the  form 

y  =  mx  +  b 

b_ 

C.4.4  Let  (3  =  e'”.  Use  the  slope,  m,  and  intercept,  b,  from  C.4.3. 


C.5.  EVALUATING  THE  WEIBULL  DISTRIBUTION  FOR  PROBABILITY 

Let  X  =  (test  valuef  -Xo-  Choose  a  test  value  such  as  12  mm.  Xo=  0-5-  Hence,  x=  I  I  5 

Enter  the  calculated  values  of  x>  end  |3  into  the  equation  in  C.2  and  solve  for  the  Weibull 
probability. 

C.6.  SAMPLE  WEIBULL  CALCULATIONS  WITH  TWELVE  DATA  POINTS 


The  following  example  utilizes  a  spreadsheet  program  to  calculate  the  Weibull  Distribution 
probability  for  System  3  after  3360  hours  of  exposure.  The  data  are  the  maximum  raw  scribe 
undercutting  ratings  measured  in  millimeters. 

As  a  numerical  example,  entries  in  the  first  row  in  the  System  3  table  are  computed  as  follows: 


I  4  The  raw  data  measurement  of  14  means  that  the  maximum  undercutting  of 

the  first  scribe  was  14  mm,  I.e.,  u  =  14. 


.  0.6250 


Since  14  is  the  8th  smallest  measurement,  it  is  given  the  rank  of  8.  There  are 
seven  other  data  points  smaller  than  14.  Notice  that  the  other  measurement 
of  14  shares  this  rank.  The  next  higher  rank  is  10. 


CDF= 


Rank-0  ,5 

number  of  data  points 


8-0.5 

12 


=  0.6250 


.  2.6667 


I 

w= - 

I -CDF 


- - =2.6667 

1-0.6250 


•  2.639’1  X  =lnCu)=ln  (143  =  2.6391 

-0.0194  y  =ln[lnCw3]  =  ln[lnC2.66673]  =  lnEO.98081  =  -0.0194 

The  computation  for  System  3  yields  a  Weibull  probability  of  0.321.  The  spreadsheet 
calculations  are  shown  below. 
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System  3 
3360  h 


Data  CuD 

Rank 

CDF 

w  =  1 /Cl -CDF) 

X  =  InCu) 

14 

8 

0,6250 

2.6667 

2.6391 

-0.0194 

8 

1 

0.0417 

1.0435 

2.0794 

-3.1568 

9 

2 

0.1250 

1.1429 

2.1972 

-2.0134 

13 

6 

0.4583 

1.8462 

-0.4892 

15 

10 

0.7917 

4.8000 

2.7081 

0.4502 

15 

10 

0.7917 

4.8000 

2.7081 

0.4502 

14 

8 

0.6250 

2.6667 

2.6391 

-0.0194 

9 

2 

0.1250 

1,1429 

2.1972 

-2.0134 

16 

12 

0.9583 

24.0000 

2.7726 

1.1563 

13 

6 

0.4583 

1.8462 

2.5649 

-0.4892 

11 

4 

0.2917 

1.4118 

2.3979 

-1  .0647 

12 

5 

0.3750 

1.6000 

2.4849 

-0.7550 

Weibull 


slope,  m  =  5.30 
y-intercept,  b  =  -13.90 
beta  = 

Xo  = 

Test  Valu^  = 


13.753 

0.5 


11.5 

12 


Probability  =  0.321 


The  Weibull  probability  of  0.321  is  the 
probability  that  the  maximum  undercutting  on  a 
scribe  will  be  less  than  the  test  value  of  12 
mm. 


Weibull  Regression  Plot  for 
System  3 

y  =  5.3046x-  13.905 


X 


The  table  below  gives  the  Weibull  probability  for  various  test  values  for  System  3. 


Test  Value 

12 

0.321 

13 

0.453 

14 

0.596 

15 

0.734 

16 

0.848 

17 

0.928 

18 

0.972 

19 

0.992 

20 

0.998 

21 

1.000 

ERDC/CERL  TR-01-74 

November  2001 


Appendix  D:  Using  Fewer  Replicates  in  Benchmarking 

This  project  used  panel  sets  of  six  replicates  with  two  scribes  per  panel.  Thus,  if  the  maximum 
undercutting  is  recorded  for  each  scribe,  12  data  points  could  be  used  to  compute  the  benchmark  in 
accordance  with  Method  2  as  described  in  the  body  of  the  report.  In  order  to  determine  if  a  viable 
benchmark  could  be  determined  using  fewer  replicates,  the  following  experiment  was  performed. 

The  six  System  2  replicates  were  randomly  divided  into  three  groups  of  two  panels  each.  Set  2X 
consisted  of  panels  2A  and  2F,  Set  2Y  consisted  of  panels  2Band  2D,  and  Set  2Z  consisted  of  panels 
2C  and  2E.  In  order  to  get  12  data  points  for  the  benchmark  computation,  each  scribe  was  divided  into 
three  equal  parts,  the  top  third,  the  middle  third,  and  the  bottom  third.  The  maximum  undercutting  in 
each  third  of  the  scribe  was  measured.  In  essence,  each  scribe  was  treated  as  three  separate  scribes. 

The  scribes  were  again  remeasured  by  the  principal  observer  so  that  this  data  is  totally  independent 
from  the  data  reported  elsewhere  in  this  report.  The  raw  data  are  given  in  Table  D1 

Table  D1;  Maximum  Undercutting  Cmm)  for  System  2  Dividing  Scribes  into  Thirds 


Data  Set 

Panel 

Upper  Scribe 

_ower  Scribe  I 

Top 

Middle 

Bottom 

Top 

Middle 

Bottom 

2X 

2A 

7 

7 

8 

7 

8 

2F 

8 

8 

10 

10 

9 

2Y 

2B 

7 

9 

11 

9 

12 

7 

2D 

8 

8 

7 

7 

1 1 

9 

2Z 

2C 

8 

8 

10 

9 

8 

2E 

7 

6 

8 

7 

7 

Each  set  of  two  panels  had  12  data  points  which  were  then  analyzed  to  compute  the  mean  and 
the  standard  deviation.  The  corresponding  benchmark  was  then  the  mean  plus  two  standard  deviations. 
The  summary  calculations  are  shown  in  Table  D2. 

The  benchmarks  for  the  two-panel  sets  were  then  compared  with  the  benchmarks  for  the 
complete  set  of  six  replicates  discussed  in  the  body  of  the  report.  The  summary  calculations  are 
displayed  in  Table  D3.  When  the  entire  set  of  six  replicates  is  used,  the  benchmark  tends  to  be  slightly 
higher.  This  is  not  unexpected  since  only  the  absolute  maximum  from  each  scribe  is  included  among  the 
data  when  all  replicates  are  considered.  For  the  two-panel  data  sets,  the  absolute  maximum  of  each 
scribe  is  included  along  with  two  lesser  entries:  If  the  undercutting  is  fairly  uniform  along  the  length  of  the 
scribe,  measurements  from  each  third  should  be  reasonably  close  to  each  other.  This  will  yield  a 
benchmark  close  to  the  six-replicate  benchmark.  Such  is  the  case  for  System  2  examined  here.  When  all 
six  replicates  were  used,  the  benchmark  was  13  mm:  when  only  two  panels  were  used  the  benchmarks 
were  10,  11,  and  12  mm. 

From  the  data  examined  here,  it  appears  that  a  reasonable  benchmark  for  scribe  undercutting 
can  be  computed  by  partitioning  the  two  scribes  on  each  panel  into  thirds  before  taking  measurements. 
This  benchmark  will  be  close  to  but  slightly  less  than  the  benchmark  computed  using  more  replicates  and 
making  only  one  measurement  per  scribe.  When  the  added  expense  of  including  more  replicate  panels  in 
an  exposure  test  is  weighed  against  the  accuracy  of  the  benchmark,  using  fewer  panels  may  be  a  viable 
option. 
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Table  D2:  Maximum  Undercutting  Cmm)  for 
System  2  Dividing  Scribes  into  Thirds 


Data  Set 

2x 

2Y 

2Z 

Undercutting 

11 

12 

10 

10 

11 

10 

10 

11 

9 

9 

9 

8 

8 

9 

8 

8 

9 

8 

8 

8 

8 

8 

8 

7 

7 

7 

7 

7 

7 

7 

7 

7 

7 

7 

7 

6 

Average,  x' 

8 

9 

8 

Std  Dev,  s 

1.4 

1.8 

1.2 

Benchmark 

x'  +  2s 

11 

12 

10 

Set  2X  included  panels  2A  and  2F. 
Set  2Y  included  panels  2B  and  2D. 
Set  2Z  included  panels  2C  and  2E. 


Data  represent  a  complete  new  set  of  measurements. 

Table  D3:  Comparison  of  Method  2  Benchmarks  for  System  2  Using  Reduced 
Sample  Size  with  Benchmarks  Computed  from  All  12  Scribes 


Three  Measurements  per  Scribe 

One  Measurement  per  Scribe  I 

Data  Set 

2x 

2Y 

2Z 

All  6  Panels 

All  6  Panels 

All  6  Panels 

All  6  Panel 

Observer 

1  ” 

1  RR 

1  ” 

1 

1* 

2 

3 

Average,  x' 

8 

9 

8 

9 

10 

9 

9 

Std  Dev,  s 

11.4 

1.8 

1.2 

1.7 

1.8 

1.9 

1.7 

Benchmark 
x'  +  2s 

11 

12 

10 

13 

13 

13 

13 

Data  set  2X  included  panels  2A  and  2F. 

Data  set  2Y  included  panels  2B  and  2D. 

Data  set  2Z  included  panels  2C  and  2E. 

*  Remeasured  by  Observer  l 

**  Data  for  2X,  2Y,  and  2Z  represent  a  complete  new  set  of  measurements 
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